-- Logs begin at Mon 2022-09-19 11:30:43 UTC, end at Mon 2022-09-19 12:33:30 UTC. -- Sep 19 11:57:20.643556 dv-cinder-850618-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 19 11:57:20.650899 dv-cinder-850618-3-smb devstack@keystone.service[81589]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 19 11:57:20.652916 dv-cinder-850618-3-smb devstack@keystone.service[81589]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 11:57:20 2022] *** Sep 19 11:57:20.652916 dv-cinder-850618-3-smb devstack@keystone.service[81589]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 11:57:20.652916 dv-cinder-850618-3-smb devstack@keystone.service[81589]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 11:57:20.652916 dv-cinder-850618-3-smb devstack@keystone.service[81589]: nodename: dv-cinder-850618-3-smb Sep 19 11:57:20.652916 dv-cinder-850618-3-smb devstack@keystone.service[81589]: machine: x86_64 Sep 19 11:57:20.652916 dv-cinder-850618-3-smb devstack@keystone.service[81589]: clock source: unix Sep 19 11:57:20.652916 dv-cinder-850618-3-smb devstack@keystone.service[81589]: pcre jit disabled Sep 19 11:57:20.653358 dv-cinder-850618-3-smb devstack@keystone.service[81589]: detected number of CPU cores: 4 Sep 19 11:57:20.653358 dv-cinder-850618-3-smb devstack@keystone.service[81589]: current working directory: / Sep 19 11:57:20.653358 dv-cinder-850618-3-smb devstack@keystone.service[81589]: detected binary path: /usr/bin/uwsgi-core Sep 19 11:57:20.653358 dv-cinder-850618-3-smb devstack@keystone.service[81589]: your processes number limit is 47680 Sep 19 11:57:20.653358 dv-cinder-850618-3-smb devstack@keystone.service[81589]: your memory page size is 4096 bytes Sep 19 11:57:20.653358 dv-cinder-850618-3-smb devstack@keystone.service[81589]: detected max file descriptor number: 2048 Sep 19 11:57:20.653358 dv-cinder-850618-3-smb devstack@keystone.service[81589]: lock engine: pthread robust mutexes Sep 19 11:57:20.653358 dv-cinder-850618-3-smb devstack@keystone.service[81589]: thunder lock: enabled Sep 19 11:57:20.653358 dv-cinder-850618-3-smb devstack@keystone.service[81589]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 19 11:57:20.653358 dv-cinder-850618-3-smb devstack@keystone.service[81589]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 11:57:20.695766 dv-cinder-850618-3-smb devstack@keystone.service[81589]: Python main interpreter initialized at 0x564033bc19c0 Sep 19 11:57:20.695766 dv-cinder-850618-3-smb devstack@keystone.service[81589]: python threads support enabled Sep 19 11:57:20.695766 dv-cinder-850618-3-smb devstack@keystone.service[81589]: your server socket listen backlog is limited to 100 connections Sep 19 11:57:20.695766 dv-cinder-850618-3-smb devstack@keystone.service[81589]: your mercy for graceful operations on workers is 90 seconds Sep 19 11:57:20.696120 dv-cinder-850618-3-smb devstack@keystone.service[81589]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 11:57:20.696243 dv-cinder-850618-3-smb devstack@keystone.service[81589]: *** Operational MODE: preforking *** Sep 19 11:57:20.696516 dv-cinder-850618-3-smb devstack@keystone.service[81589]: *** uWSGI is running in multiple interpreter mode *** Sep 19 11:57:20.696516 dv-cinder-850618-3-smb devstack@keystone.service[81589]: spawned uWSGI master process (pid: 81589) Sep 19 11:57:20.696717 dv-cinder-850618-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 19 11:57:20.697406 dv-cinder-850618-3-smb devstack@keystone.service[81589]: spawned uWSGI worker 1 (pid: 81602, cores: 1) Sep 19 11:57:20.698637 dv-cinder-850618-3-smb devstack@keystone.service[81589]: spawned uWSGI worker 2 (pid: 81603, cores: 1) Sep 19 11:57:20.698637 dv-cinder-850618-3-smb devstack@keystone.service[81589]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 11:57:24.977829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:57:24.977829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: from cryptography.utils import int_from_bytes Sep 19 11:57:24.978596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:57:24.978596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: from cryptography.utils import int_from_bytes Sep 19 11:57:24.978712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:57:24.978712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: from cryptography.utils import int_from_bytes Sep 19 11:57:24.978712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:57:24.978712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: from cryptography.utils import int_from_bytes Sep 19 11:57:25.028354 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:57:25.028526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:57:25.028526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:57:25.028681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:57:25.028758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] command line args: [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:57:25.028826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] command line args: [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:57:25.028972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:57:25.029058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:57:25.029134 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ================================================================================ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:57:25.029206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ================================================================================ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:57:25.029386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] admin_token = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.029468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] admin_token = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.029642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config_dir = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.029719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config_dir = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.029843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.029925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.030023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config_source = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.030102 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config_source = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.030208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] debug = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.030284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] debug = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.030448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.030695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.030845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.030926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.030985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.031098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.031232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.031315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.031484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.031595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.031716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.031824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.031923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_config_append = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.032022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_config_append = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.032129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.032229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.032323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_dir = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.032415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_dir = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.032514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.032612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.032736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.032809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.032933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.033011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.033131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.033208 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.033333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.033408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.033525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.033603 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.033699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.033785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.033891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.034018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.034137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.034213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.034372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.034497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.034610 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.034725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.034837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.034948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.035065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.035195 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.035308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.035430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.035534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.035642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.035779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.035905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.036287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.036405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.036530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] publish_errors = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.036648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] publish_errors = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.036765 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.036883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.036994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.037115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.037227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.037338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.037453 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.037584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.037734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.037848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.037966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] standard_threads = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.038068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] standard_threads = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.038178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.038296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.038414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.038533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.038646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.038757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.038873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_journal = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.039035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_journal = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.039154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_json = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.039266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_json = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.039377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_stderr = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.039494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_stderr = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.039607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_syslog = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.039730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_syslog = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.039843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.039955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:57:25.040065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.040182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.040295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.040418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.040537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.040659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.040776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.040889 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.041005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.041125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.041237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.041349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.041466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.041584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.041721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.041846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.041959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.042076 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.042188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.042299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.042415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.042535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.042648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.042760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.042875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.043000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.043113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.043237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.043350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.043462 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.043572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.043684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.043796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.043916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.044034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.044153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.044265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.044376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.044487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.044673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.044788 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.044901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.045011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.045123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.045242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.045355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.045471 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.045583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.045734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.045848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.045969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.046082 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.046194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.046305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.046416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.046533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.046654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.046767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.046884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.046997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.047109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.047225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.047346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.047458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.047570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.047680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.047791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.047902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.048030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.048030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.048240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.048240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.048448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.048448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.048665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.048778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.048895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.049013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.049125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.049235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.049354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.049467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.049577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.049709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.049828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.049939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.050123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.050238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.050349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.050460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.050570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.050681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.050800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.050912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.051029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.051141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.051258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.051369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.051491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.051603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.051720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.051831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.051941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.052052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.052174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.052286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.052403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.052520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.052631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.052747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.052865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.052977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.053088 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.053216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.053320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.053426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.053522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.053658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.053763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.053857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.053951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.054056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.054153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.054272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.054389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.054501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.054613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.054734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.054856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.054984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.055099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.055212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.055323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.055436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.055548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.055671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.055791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.055904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.056016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.056129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.056241 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.056364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.056479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.056591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.056702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.056814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.056925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.057048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.057162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.057280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.057383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.057495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.057606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.057745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.057850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.057962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.058074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.058186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.058298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.058418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.058533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.058644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.058762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.058876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.058988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.059108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.059221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.059333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.059445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.059558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.059670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.059790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.059904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.060015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.060127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.060238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.060356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.060481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.060601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.060714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.060826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.060938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.061055 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.061241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.061356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.061468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.062240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.062359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.062485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.062609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.062736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.062862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.062977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.063089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.063202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.063314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.063435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.063550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.063662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.063776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.063888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.063888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.064106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.064221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.064341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.064453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.064576 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.064689 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.064818 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.064933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.065045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.065157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.065269 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.065269 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.external = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.065523 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.065681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.065795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.external = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.065795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.066012 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.066012 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.066223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.066336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.password = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.066457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.066579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.token = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.066693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.password = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.066693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.token = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.066912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.067026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.067147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.067262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.067374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.067487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.067599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.067712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.067833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.067948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.068061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.068174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.068286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.068398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.068519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.068633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.068751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.068865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.068978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.069092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.069203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.069317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.069430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.069542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.069667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.069781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.069906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.070028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.070142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.070255 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.070368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.070480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.070601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.070715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.070828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.070940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.071052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.071166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.071287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.071401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.071514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.071632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.071746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.071859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.071981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.072095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.072217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.072331 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.072450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.072567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.072691 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.072806 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.072919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.072919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.073129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.073129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.073352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.073467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.073580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.073718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.073831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.073956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.074072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.074185 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.074298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.074411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.074523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.074644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.074767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.074880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.074993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.075105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.075218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.075406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.075522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.075636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.075739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.075739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.075949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.075949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.076170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.076170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.076381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.076493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.076605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.076605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.076832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.076946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.077058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.077170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.077866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.077997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.078113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.078226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.078346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.078461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.078574 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.078702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.078806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.078806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.079016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.079016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.079227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.079349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.079349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.079572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.079688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.079800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.079913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.080034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.080149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.080267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.080381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.080494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.080607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.080728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.080842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.080954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.081066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.081179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.081291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.081412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.081527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.081693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.081809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.081921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.082034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.082159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.082274 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.082390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.082504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.082617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.082730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.082852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.082967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.083080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.083199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.083313 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.083433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.083548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.083662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.083775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.083888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.084001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.084126 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.084241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.084354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.084467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.084579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.084693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.084814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.084929 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.085042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.085154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.085267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.085379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.085499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.085614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.085748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.085859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.085972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.086085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.086209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.086324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.086437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.086550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.086669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.086783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.086906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.087020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.087133 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.087245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.087366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.087480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.087600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.087715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.087828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.087942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.088055 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.088168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.088289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.088404 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.088517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.088629 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.088741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.088854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.088854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.089081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.089195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.089292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.089404 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.089516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.089690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.089806 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.089919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.090033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.090146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.090259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.090383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.090498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.090611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.090723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.090835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.090947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.091069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.091184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.091297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.091409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.091522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.091641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.091763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.091877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.092032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.092148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.092264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.092387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.092509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.092624 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.092737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.092852 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.092965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.093079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.093200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.093315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.093468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.093580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.093711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.093824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.093949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.094064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.094064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.094277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.094389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.094501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.094623 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.094737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.094850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.094963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.095075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.095189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.095310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.095424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.095537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.095648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.095761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.095873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.095994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.096108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.096221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.096333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.096446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.096558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.096679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.096793 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.096905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.097017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.097129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.097241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.097363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.097478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.097590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.097722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.097835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.097948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.098139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.098256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.098370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.098484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.098596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.098718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.098832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.098951 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.099065 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.099436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.099553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.099674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.099789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.099902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.100014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.100127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.100240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.100361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.100477 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.100590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.100703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.100815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.100928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.101048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.101163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.101275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.101387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.101501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.101615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.101774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.101890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.102004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.102120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.102233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.102345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.102466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.102581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.102694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.102806 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.102918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.103031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.103151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.103265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.103379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.103492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.103606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.103726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.103841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.103954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.104068 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.104180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.104293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.104413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.104527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.104641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.104754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.104866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.104979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.105100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.105214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.105327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.105439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.105552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.105678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.105805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.105921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.106034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.106147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.106260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.106373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.106494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.106608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.106723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.106835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.106947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.107060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.107180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.107295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.107408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.107521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.107634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.107746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.107868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.107988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.108102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.108215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.108327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.108439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.108560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.108674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.108787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.108900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.109013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.109125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.109245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.109360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.109472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.109585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.109743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.109857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.109983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.110098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.110211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.110336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.110465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.110587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.110702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.110815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.110929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.111050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.111164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.111277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.111390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.111503 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.111617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.111738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.111853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.111978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.112094 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.112206 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.112319 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.112440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.112555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.112668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.112781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.112894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.113008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.113130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.113244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.113357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.113469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.113582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.113711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.113837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.113953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.114067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.114180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.114293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.114406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.114528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.114648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.114762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.114875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.114989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.115102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.115102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:57:25.115324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:57:25.115324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:57:25.144541 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.144763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.144871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.144988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.145069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.145212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.153521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.158550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.182183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.182411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.184450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.184680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.236754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.236904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.285749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.285978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.286549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.286782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.442697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.442922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.443144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.443336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.443425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.443574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.443715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.443798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.443980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.444203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.444424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.444643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.467427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.467573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.467655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.468502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.468621 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.468699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.468770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.468895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.469110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.469200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.469330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.469407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.469594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.469838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.480957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.483108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.494045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.494225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.494308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.494444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.494546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.494667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.494755 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.494881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.494959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.495094 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.495173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.495306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.495384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.495516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:57:25.512136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.512327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.512410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:57:25.512535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:57:25.512667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.512863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:57:25.512957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.513060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:57:25.513139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.513331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.513412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.513596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.513706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.513876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.513955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.514131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.524157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.524262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.524434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.524515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.524701 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.524781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.524986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.525066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.532567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.532658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.535472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.535567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.535756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.535835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.536035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.536113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.536315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.536406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.536594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.536673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.536850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.536927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.537114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.537196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.537382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.537459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.537669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.537763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.537943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.538021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.538207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.538284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.560670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.561120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.562190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.562472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.562843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.563138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.567107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.567390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.567665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.567846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.568128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.568404 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.573992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.574276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.574830 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.575113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.580450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.580745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.581032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.581320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.581399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.581597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.581707 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.581902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.581982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.582172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.582252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.582439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.582519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.582713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.582983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.583248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.598651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.598921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.599425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.599709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.603037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.603492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.606281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.606577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.606692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.606987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.611152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.611260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.614222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.614306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.617493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.617760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.617888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.618059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.618156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.618337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.618421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.618615 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.618697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.618899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.618978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.619185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.634685 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.634972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.635089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.635236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.635374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.635497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.635638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.635899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.642930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.643396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.644462 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.644938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.646011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.646286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.646491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.646767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.648925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.649209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.649409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.649490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.649723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.649804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.650005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.650155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.650284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.650677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.662023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.662304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.662463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.662602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.662736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.662877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.663011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.663202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.663342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.663473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.663642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.663790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.663933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.664194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.679241 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.679560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.682154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.682463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.685071 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.685352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.687089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.687369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.688551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.688832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.689041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.689242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.689436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.689725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.695576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.696057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.697020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.697506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.699909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.700302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.700382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.700588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.700773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.700864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.701060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.701339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.709264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.709561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.709868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.710025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.710326 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.710608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.716721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.717002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.717286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.717422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:57:25.717562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.717907 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.717993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.718180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.718397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.718467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.718683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.718780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.718958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.719048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.719233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.719314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.719517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.719597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.719774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.719851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.720060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.720164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.720314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.720397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.720591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.720852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.721127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.721395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:57:25.754994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564033bc19c0 pid: 81602 (default app) Sep 19 11:57:25.755800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564033bc19c0 pid: 81603 (default app) Sep 19 11:57:25.758297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da403-e075-40b3-a14e-b5825ed395a3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.758587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da403-e075-40b3-a14e-b5825ed395a3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.758861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da403-e075-40b3-a14e-b5825ed395a3 None None] PATH_INFO: `/v3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.763069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Mon Sep 19 11:57:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:32.626693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6d8f-e517-4990-90f5-128f3509028e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.627201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6d8f-e517-4990-90f5-128f3509028e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.627307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6d8f-e517-4990-90f5-128f3509028e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.631525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:57:32.636808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.637414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.637414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.710880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: INFO dbcounter [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] Registered counter for database keystone Sep 19 11:57:32.730498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG oslo_db.sqlalchemy.engines [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:57:32.737226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writer thread running {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:57:32.914038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG passlib.handlers.bcrypt [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81602) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 11:57:32.914350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG passlib.handlers.bcrypt [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81602) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 11:57:32.971798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:32.973391 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:33.098192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 11:57:33.580720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6d8f-e517-4990-90f5-128f3509028e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:33.653140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: INFO dbcounter [None req-6cfc6d8f-e517-4990-90f5-128f3509028e None None] Registered counter for database keystone Sep 19 11:57:33.675208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG oslo_db.sqlalchemy.engines [None req-6cfc6d8f-e517-4990-90f5-128f3509028e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:57:33.681341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writer thread running {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:57:33.800546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6d8f-e517-4990-90f5-128f3509028e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:33.804882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e83b1-9db3-48fe-884f-09b139f03f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:33.805503 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e83b1-9db3-48fe-884f-09b139f03f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.805817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e83b1-9db3-48fe-884f-09b139f03f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.806095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e83b1-9db3-48fe-884f-09b139f03f0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.814225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e83b1-9db3-48fe-884f-09b139f03f0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:33.866427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd3e83b1-9db3-48fe-884f-09b139f03f0e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 11:57:33.866711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e83b1-9db3-48fe-884f-09b139f03f0e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:33.876171 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Sep 19 11:57:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:57:33.882171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:33.899019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34d3c7-ccf5-4fcf-b11a-93ee0d0a4fcd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:33.903330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e9426-3b82-4c22-b062-2f558a77137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:33.904429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9426-3b82-4c22-b062-2f558a77137b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.904710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9426-3b82-4c22-b062-2f558a77137b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.905156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9426-3b82-4c22-b062-2f558a77137b admin admin] PATH_INFO: `/v3/projects/ae0bb369f1514f798528db70a760243b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.907253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9426-3b82-4c22-b062-2f558a77137b admin admin] RBAC: Authorizing `identity:get_project(project_id=ae0bb369f1514f798528db70a760243b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:33.959614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WARNING keystone.common.rbac_enforcer.enforcer [None req-923e9426-3b82-4c22-b062-2f558a77137b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 11:57:33.959950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9426-3b82-4c22-b062-2f558a77137b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:33.964427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Mon Sep 19 11:57:33 2022] GET /identity/v3/projects/ae0bb369f1514f798528db70a760243b => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:36.071974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae479e0-cc42-4769-a3a9-84ef0ee71d3e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:36.072485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae479e0-cc42-4769-a3a9-84ef0ee71d3e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:36.072572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae479e0-cc42-4769-a3a9-84ef0ee71d3e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:36.076670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:57:36.082478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226387a-4e73-4768-b561-fa81cf614098 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:36.082892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226387a-4e73-4768-b561-fa81cf614098 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:36.083037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226387a-4e73-4768-b561-fa81cf614098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:36.102935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b226387a-4e73-4768-b561-fa81cf614098 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:36.104434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b226387a-4e73-4768-b561-fa81cf614098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:36.112771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 11:57:36.385156 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae479e0-cc42-4769-a3a9-84ef0ee71d3e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:36.397636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae479e0-cc42-4769-a3a9-84ef0ee71d3e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:36.401897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cbef2-6729-4fc0-ab1c-ff7c1c83eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:36.402532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cbef2-6729-4fc0-ab1c-ff7c1c83eb05 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:36.402817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cbef2-6729-4fc0-ab1c-ff7c1c83eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:36.403096 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cbef2-6729-4fc0-ab1c-ff7c1c83eb05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:36.411483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cbef2-6729-4fc0-ab1c-ff7c1c83eb05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:36.413250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cbef2-6729-4fc0-ab1c-ff7c1c83eb05 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:36.422780 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Sep 19 11:57:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:57:36.427962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226387a-4e73-4768-b561-fa81cf614098 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:36.437125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226387a-4e73-4768-b561-fa81cf614098 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:36.441414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a50368-169f-4f36-b6dc-65222579a9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:36.442070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50368-169f-4f36-b6dc-65222579a9ef admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:36.442380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50368-169f-4f36-b6dc-65222579a9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:36.442659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50368-169f-4f36-b6dc-65222579a9ef admin admin] PATH_INFO: `/v3/users/42e8360255b24c6f83e6dd2dd021babf` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:36.443976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a50368-169f-4f36-b6dc-65222579a9ef admin admin] RBAC: Authorizing `identity:get_user(user_id=42e8360255b24c6f83e6dd2dd021babf)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:36.445828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a50368-169f-4f36-b6dc-65222579a9ef admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:36.447338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Mon Sep 19 11:57:36 2022] GET /identity/v3/users/42e8360255b24c6f83e6dd2dd021babf => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:38.651245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3304-8e74-46b1-b8a9-c2247a0ed2ad None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:38.651779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3304-8e74-46b1-b8a9-c2247a0ed2ad None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:38.651779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3304-8e74-46b1-b8a9-c2247a0ed2ad None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:38.653090 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:38.659102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22710434-4033-4cb9-9b40-71c7815c3fa2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:38.659539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22710434-4033-4cb9-9b40-71c7815c3fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:38.659682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22710434-4033-4cb9-9b40-71c7815c3fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:38.678963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-22710434-4033-4cb9-9b40-71c7815c3fa2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:38.680127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-22710434-4033-4cb9-9b40-71c7815c3fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:38.693962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b342d-95ba-4f2e-a1de-c647d6cc69ad None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:38.694250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b342d-95ba-4f2e-a1de-c647d6cc69ad None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:38.694525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b342d-95ba-4f2e-a1de-c647d6cc69ad None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:38.695840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:57:38.700741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e57fa-7e1e-42e9-a174-54eb26c3a375 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:38.701204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e57fa-7e1e-42e9-a174-54eb26c3a375 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:38.701481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e57fa-7e1e-42e9-a174-54eb26c3a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:38.744122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG passlib.handlers.bcrypt [None req-8f1e57fa-7e1e-42e9-a174-54eb26c3a375 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81603) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 11:57:38.744516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG passlib.handlers.bcrypt [None req-8f1e57fa-7e1e-42e9-a174-54eb26c3a375 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81603) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 11:57:38.760672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:57:38.793961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8f1e57fa-7e1e-42e9-a174-54eb26c3a375 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:38.795543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8f1e57fa-7e1e-42e9-a174-54eb26c3a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:38.892810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:57:39.029645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22710434-4033-4cb9-9b40-71c7815c3fa2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.053350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:39.133635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22710434-4033-4cb9-9b40-71c7815c3fa2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.159262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e57fa-7e1e-42e9-a174-54eb26c3a375 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.166930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20456-7020-4cb4-888e-6d96138a12c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.167575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20456-7020-4cb4-888e-6d96138a12c6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.167860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20456-7020-4cb4-888e-6d96138a12c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.168140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20456-7020-4cb4-888e-6d96138a12c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.179872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a20456-7020-4cb4-888e-6d96138a12c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-60a20456-7020-4cb4-888e-6d96138a12c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:57:39.189474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:57:39.190395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:57:39.191190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:57:39.196426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20456-7020-4cb4-888e-6d96138a12c6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.260325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e57fa-7e1e-42e9-a174-54eb26c3a375 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.262563 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:39.277499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:39.295882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20456-7020-4cb4-888e-6d96138a12c6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.299472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96399cbe-84c9-40a2-a545-1f7485453df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.300332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399cbe-84c9-40a2-a545-1f7485453df8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.300619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399cbe-84c9-40a2-a545-1f7485453df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.300898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399cbe-84c9-40a2-a545-1f7485453df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.330398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e819-2eea-4202-8826-40bc79412009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.331005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e819-2eea-4202-8826-40bc79412009 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.331318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e819-2eea-4202-8826-40bc79412009 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.331600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e819-2eea-4202-8826-40bc79412009 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.332269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0e819-2eea-4202-8826-40bc79412009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:39.332575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0e819-2eea-4202-8826-40bc79412009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.334013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0e819-2eea-4202-8826-40bc79412009 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.345569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 8/15] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:39.351604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e819-2eea-4202-8826-40bc79412009 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.366541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96399cbe-84c9-40a2-a545-1f7485453df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.368058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96399cbe-84c9-40a2-a545-1f7485453df8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.447582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e819-2eea-4202-8826-40bc79412009 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.469681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 8/16] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:57:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:57:39.471793 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96399cbe-84c9-40a2-a545-1f7485453df8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.474823 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:39.484294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a025694-5834-4b81-b2f8-66b044f95a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.484928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025694-5834-4b81-b2f8-66b044f95a3c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.485207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025694-5834-4b81-b2f8-66b044f95a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.485479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025694-5834-4b81-b2f8-66b044f95a3c None admin] PATH_INFO: `/v3/users/42e8360255b24c6f83e6dd2dd021babf` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.486764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a025694-5834-4b81-b2f8-66b044f95a3c None admin] RBAC: Authorizing `identity:get_user(user_id=42e8360255b24c6f83e6dd2dd021babf)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.488579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a025694-5834-4b81-b2f8-66b044f95a3c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.490179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 9/17] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:57:39 2022] GET /identity/v3/users/42e8360255b24c6f83e6dd2dd021babf => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:39.495838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a025694-5834-4b81-b2f8-66b044f95a3c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.512573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:39.569084 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96399cbe-84c9-40a2-a545-1f7485453df8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.597856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a025694-5834-4b81-b2f8-66b044f95a3c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.601534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f93e1-a427-4686-ab87-1c521ce3c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.602417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f93e1-a427-4686-ab87-1c521ce3c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.602698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f93e1-a427-4686-ab87-1c521ce3c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.602976 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f93e1-a427-4686-ab87-1c521ce3c2b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.621449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f93e1-a427-4686-ab87-1c521ce3c2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.622945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f93e1-a427-4686-ab87-1c521ce3c2b6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.632881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631c571-decc-44e2-85a2-c4f532b03089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.633579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c571-decc-44e2-85a2-c4f532b03089 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.633890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c571-decc-44e2-85a2-c4f532b03089 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.634161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c571-decc-44e2-85a2-c4f532b03089 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.635262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631c571-decc-44e2-85a2-c4f532b03089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.636698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631c571-decc-44e2-85a2-c4f532b03089 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.638286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 10/18] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:57:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-552f93e1-a427-4686-ab87-1c521ce3c2b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:57:39.641373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:57:39.642243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:57:39.643040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:57:39.643040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:57:39.643040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:57:39.643040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 9/19] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:57:39.648101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f93e1-a427-4686-ab87-1c521ce3c2b6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.648204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631c571-decc-44e2-85a2-c4f532b03089 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.704191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:39.728219 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:39.749795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631c571-decc-44e2-85a2-c4f532b03089 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.751297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f93e1-a427-4686-ab87-1c521ce3c2b6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.783456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb1d62-9312-4c2e-9ea8-40da4936fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.783645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7211644-b68b-44c5-b554-c0eaed05fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.784068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb1d62-9312-4c2e-9ea8-40da4936fafc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.784177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211644-b68b-44c5-b554-c0eaed05fe1c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.784345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb1d62-9312-4c2e-9ea8-40da4936fafc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.784460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211644-b68b-44c5-b554-c0eaed05fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.784614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb1d62-9312-4c2e-9ea8-40da4936fafc None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.784732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211644-b68b-44c5-b554-c0eaed05fe1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.785247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb1d62-9312-4c2e-9ea8-40da4936fafc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:39.785442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7211644-b68b-44c5-b554-c0eaed05fe1c None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.domain.id=default, user.id=42e8360255b24c6f83e6dd2dd021babf) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:39.785534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb1d62-9312-4c2e-9ea8-40da4936fafc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.785778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7211644-b68b-44c5-b554-c0eaed05fe1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.786928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb1d62-9312-4c2e-9ea8-40da4936fafc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.787203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7211644-b68b-44c5-b554-c0eaed05fe1c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.795091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 10/20] 10.222.0.50 () {56 vars in 1322 bytes} [Mon Sep 19 11:57:39 2022] GET /identity/v3/role_assignments?user.id=42e8360255b24c6f83e6dd2dd021babf&scope.domain.id=default&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:39.805224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 11/21] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:42.288646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e1469-3036-49e4-a111-e93b6123a0f0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.289711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e1469-3036-49e4-a111-e93b6123a0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.290201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e1469-3036-49e4-a111-e93b6123a0f0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.291720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 11/22] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:42.297826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4738238-d06d-4ee4-8835-ce2bf7f3ca57 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.298642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4738238-d06d-4ee4-8835-ce2bf7f3ca57 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.299190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4738238-d06d-4ee4-8835-ce2bf7f3ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.326617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f4738238-d06d-4ee4-8835-ce2bf7f3ca57 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:42.328307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f4738238-d06d-4ee4-8835-ce2bf7f3ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:42.338246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dec2f-f550-4774-a139-d95a589723fb None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.338829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dec2f-f550-4774-a139-d95a589723fb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.339322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dec2f-f550-4774-a139-d95a589723fb None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.341346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 12/23] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:42.349067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99dd63-dff1-4685-9a69-8379cef1e968 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.349720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99dd63-dff1-4685-9a69-8379cef1e968 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.350190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99dd63-dff1-4685-9a69-8379cef1e968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.386671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fb99dd63-dff1-4685-9a69-8379cef1e968 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:42.388264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fb99dd63-dff1-4685-9a69-8379cef1e968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:42.433932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 12/24] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:57:42.488249 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a436-86f2-45bc-a71c-9b2f470efcc9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.488864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a436-86f2-45bc-a71c-9b2f470efcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.489542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a436-86f2-45bc-a71c-9b2f470efcc9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.491310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 13/25] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:57:42.499393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd90fa-cd90-46ab-82c0-954b6faf9537 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.500001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd90fa-cd90-46ab-82c0-954b6faf9537 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.500476 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd90fa-cd90-46ab-82c0-954b6faf9537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.513275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 13/26] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:57:42.534692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-88cd90fa-cd90-46ab-82c0-954b6faf9537 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:42.536217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-88cd90fa-cd90-46ab-82c0-954b6faf9537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:42.630445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:42.635371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 14/27] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:57:42.978914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99dd63-dff1-4685-9a69-8379cef1e968 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:43.009328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd90fa-cd90-46ab-82c0-954b6faf9537 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:43.038736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:43.132001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd90fa-cd90-46ab-82c0-954b6faf9537 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:43.146810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99dd63-dff1-4685-9a69-8379cef1e968 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:43.176060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111c77d-0e3a-48c8-af56-74f5f17e5348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:43.177099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111c77d-0e3a-48c8-af56-74f5f17e5348 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.177600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111c77d-0e3a-48c8-af56-74f5f17e5348 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.178255 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111c77d-0e3a-48c8-af56-74f5f17e5348 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.191639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111c77d-0e3a-48c8-af56-74f5f17e5348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3111c77d-0e3a-48c8-af56-74f5f17e5348 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:57:43.197453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:57:43.198300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:57:43.199069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:57:43.201333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 15/28] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:57:43.202396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111c77d-0e3a-48c8-af56-74f5f17e5348 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:43.220504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94d80a-ca13-4459-a629-c53ef1897b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:43.221144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94d80a-ca13-4459-a629-c53ef1897b4a None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.221428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94d80a-ca13-4459-a629-c53ef1897b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.221726 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94d80a-ca13-4459-a629-c53ef1897b4a None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.222634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94d80a-ca13-4459-a629-c53ef1897b4a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:43.224166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94d80a-ca13-4459-a629-c53ef1897b4a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:43.296237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:43.342184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111c77d-0e3a-48c8-af56-74f5f17e5348 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:43.374887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 14/29] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Sep 19 11:57:42 2022] POST /identity/v3/roles => generated 219 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:43.375874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94d80a-ca13-4459-a629-c53ef1897b4a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:43.379934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56af84e-1eba-4fd5-8be6-6932d2f8fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:43.382907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56af84e-1eba-4fd5-8be6-6932d2f8fa0b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.385663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56af84e-1eba-4fd5-8be6-6932d2f8fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.385663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56af84e-1eba-4fd5-8be6-6932d2f8fa0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.412202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56af84e-1eba-4fd5-8be6-6932d2f8fa0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:43.413770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56af84e-1eba-4fd5-8be6-6932d2f8fa0b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a56af84e-1eba-4fd5-8be6-6932d2f8fa0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:57:43.431804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:57:43.432712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:57:43.433489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:57:43.433489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:57:43.433489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:57:43.433489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 16/30] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:57:43.434872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923576ad-6e08-4222-81de-f67448c54ab4 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.435158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923576ad-6e08-4222-81de-f67448c54ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.435432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923576ad-6e08-4222-81de-f67448c54ab4 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.437121 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 17/31] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:43.442490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923576ad-6e08-4222-81de-f67448c54ab4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:43.578995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923576ad-6e08-4222-81de-f67448c54ab4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:43.610080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:43.617024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94d80a-ca13-4459-a629-c53ef1897b4a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:43.636379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:43.644291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519446a-ccf1-4d33-b9fd-5223f9f0aaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:43.644637 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519446a-ccf1-4d33-b9fd-5223f9f0aaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.644922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519446a-ccf1-4d33-b9fd-5223f9f0aaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.645224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519446a-ccf1-4d33-b9fd-5223f9f0aaa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.646188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519446a-ccf1-4d33-b9fd-5223f9f0aaa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:43.646491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519446a-ccf1-4d33-b9fd-5223f9f0aaa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:43.648105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519446a-ccf1-4d33-b9fd-5223f9f0aaa0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:43.665121 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 18/32] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:43.669665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf953-3163-4e9b-9f37-fe3ef3445192 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.669665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf953-3163-4e9b-9f37-fe3ef3445192 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.669665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf953-3163-4e9b-9f37-fe3ef3445192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.691098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-df4bf953-3163-4e9b-9f37-fe3ef3445192 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:43.692564 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-df4bf953-3163-4e9b-9f37-fe3ef3445192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:43.694051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b832922-6421-4c05-a761-e8f74da6d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:43.694679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b832922-6421-4c05-a761-e8f74da6d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.694958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b832922-6421-4c05-a761-e8f74da6d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.695258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b832922-6421-4c05-a761-e8f74da6d5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.696618 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b832922-6421-4c05-a761-e8f74da6d5c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:43.696618 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b832922-6421-4c05-a761-e8f74da6d5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:43.699085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b832922-6421-4c05-a761-e8f74da6d5c1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:43.723307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 15/33] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:43.724235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b832922-6421-4c05-a761-e8f74da6d5c1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:43.796441 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 19/34] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:57:43.797304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bf953-3163-4e9b-9f37-fe3ef3445192 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:43.886817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b832922-6421-4c05-a761-e8f74da6d5c1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:43.923934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11adf29-09d8-494c-9403-180007fb6f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:43.924560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11adf29-09d8-494c-9403-180007fb6f9d None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.924845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11adf29-09d8-494c-9403-180007fb6f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.925122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11adf29-09d8-494c-9403-180007fb6f9d None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.926062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11adf29-09d8-494c-9403-180007fb6f9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:43.927756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11adf29-09d8-494c-9403-180007fb6f9d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:43.933731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bf953-3163-4e9b-9f37-fe3ef3445192 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:43.935443 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:43.962860 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 16/35] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:57:43 2022] POST /identity/v3/projects => generated 301 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:43.969647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02935-b981-480e-8ddb-82ac90f01ddf None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.969647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02935-b981-480e-8ddb-82ac90f01ddf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.969647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02935-b981-480e-8ddb-82ac90f01ddf None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.969647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 17/36] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:43.972562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcd028-f1af-49f7-b4b7-2e913ec4294d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.972861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcd028-f1af-49f7-b4b7-2e913ec4294d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.973142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcd028-f1af-49f7-b4b7-2e913ec4294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.995580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-60dcd028-f1af-49f7-b4b7-2e913ec4294d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:43.997387 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-60dcd028-f1af-49f7-b4b7-2e913ec4294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:43.997830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd84df-33fd-46e4-bba7-6db9612a3601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:43.998638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd84df-33fd-46e4-bba7-6db9612a3601 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.999096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd84df-33fd-46e4-bba7-6db9612a3601 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.999814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd84df-33fd-46e4-bba7-6db9612a3601 None admin] PATH_INFO: `/v3/users/42e8360255b24c6f83e6dd2dd021babf` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:44.006009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd84df-33fd-46e4-bba7-6db9612a3601 None admin] RBAC: Authorizing `identity:get_user(user_id=42e8360255b24c6f83e6dd2dd021babf)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:44.007833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd84df-33fd-46e4-bba7-6db9612a3601 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:44.009782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 20/37] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:57:43 2022] GET /identity/v3/users/42e8360255b24c6f83e6dd2dd021babf => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:44.016107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd84df-33fd-46e4-bba7-6db9612a3601 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:44.021527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:44.121113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 18/38] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:57:44.122216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcd028-f1af-49f7-b4b7-2e913ec4294d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:44.204983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd84df-33fd-46e4-bba7-6db9612a3601 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:44.245954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209e54-22a7-4b2c-97ae-d4e4de03d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:44.246597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209e54-22a7-4b2c-97ae-d4e4de03d6aa None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:44.246874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209e54-22a7-4b2c-97ae-d4e4de03d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:44.247146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209e54-22a7-4b2c-97ae-d4e4de03d6aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:44.248274 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07209e54-22a7-4b2c-97ae-d4e4de03d6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:44.250511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07209e54-22a7-4b2c-97ae-d4e4de03d6aa None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:44.252908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 21/39] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:57:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:44.258503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209e54-22a7-4b2c-97ae-d4e4de03d6aa None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:44.282256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcd028-f1af-49f7-b4b7-2e913ec4294d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:44.312396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:44.328285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76c78e-aa4e-417a-a4e0-86a843fe4f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:44.330661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76c78e-aa4e-417a-a4e0-86a843fe4f4e None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:44.330661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76c78e-aa4e-417a-a4e0-86a843fe4f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:44.330661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76c78e-aa4e-417a-a4e0-86a843fe4f4e None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:44.330661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76c78e-aa4e-417a-a4e0-86a843fe4f4e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:44.333180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76c78e-aa4e-417a-a4e0-86a843fe4f4e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:44.348053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 19/40] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Sep 19 11:57:44 2022] POST /identity/v3/roles => generated 225 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:44.349349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0eaae-35ce-4b5d-a0f5-a84d7fcfb23f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:44.349852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0eaae-35ce-4b5d-a0f5-a84d7fcfb23f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:44.350019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0eaae-35ce-4b5d-a0f5-a84d7fcfb23f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:44.355320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 20/41] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:44.357255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c417-7bc2-45cc-990f-1495f6d731e8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:44.357548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c417-7bc2-45cc-990f-1495f6d731e8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:44.357908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775c417-7bc2-45cc-990f-1495f6d731e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:44.383831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c775c417-7bc2-45cc-990f-1495f6d731e8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:44.385121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c775c417-7bc2-45cc-990f-1495f6d731e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:44.400387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209e54-22a7-4b2c-97ae-d4e4de03d6aa None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:44.403317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:44.443995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa868036-70d5-4783-9ecf-c19003c55f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:44.444775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa868036-70d5-4783-9ecf-c19003c55f16 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:44.445060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa868036-70d5-4783-9ecf-c19003c55f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:44.445381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa868036-70d5-4783-9ecf-c19003c55f16 None admin] PATH_INFO: `/v3/domains/default/users/42e8360255b24c6f83e6dd2dd021babf/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:44.447472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa868036-70d5-4783-9ecf-c19003c55f16 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=42e8360255b24c6f83e6dd2dd021babf, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:44.449011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa868036-70d5-4783-9ecf-c19003c55f16 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:44.468828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 21/42] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:57:44.469597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775c417-7bc2-45cc-990f-1495f6d731e8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:44.603029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775c417-7bc2-45cc-990f-1495f6d731e8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:44.643461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe6a7d-824a-46fe-b2f8-712ac5704fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:44.644095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe6a7d-824a-46fe-b2f8-712ac5704fa1 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:44.644380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe6a7d-824a-46fe-b2f8-712ac5704fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:44.644662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe6a7d-824a-46fe-b2f8-712ac5704fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:44.645349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe6a7d-824a-46fe-b2f8-712ac5704fa1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:44.646822 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe6a7d-824a-46fe-b2f8-712ac5704fa1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:44.663247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 22/43] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Sep 19 11:57:44 2022] POST /identity/v3/roles => generated 223 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:44.681850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 22/44] 10.222.0.50 () {58 vars in 1361 bytes} [Mon Sep 19 11:57:44 2022] PUT /identity/v3/domains/default/users/42e8360255b24c6f83e6dd2dd021babf/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:44.751531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe6a7d-824a-46fe-b2f8-712ac5704fa1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:44.755768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:44.868528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe6a7d-824a-46fe-b2f8-712ac5704fa1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:44.904738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdea33-6b84-462a-8b25-8dfb962ff576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:44.905440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdea33-6b84-462a-8b25-8dfb962ff576 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:44.905989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdea33-6b84-462a-8b25-8dfb962ff576 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:44.906280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdea33-6b84-462a-8b25-8dfb962ff576 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:44.907420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdea33-6b84-462a-8b25-8dfb962ff576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:44.908860 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdea33-6b84-462a-8b25-8dfb962ff576 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:44.910624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 23/45] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:57:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:44.916397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa868036-70d5-4783-9ecf-c19003c55f16 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:45.012153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:45.016174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa868036-70d5-4783-9ecf-c19003c55f16 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:45.050492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81f491-02f4-4fab-af53-4efe468e063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:45.051109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f491-02f4-4fab-af53-4efe468e063f None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:45.051376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f491-02f4-4fab-af53-4efe468e063f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:45.051647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f491-02f4-4fab-af53-4efe468e063f None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:45.052308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81f491-02f4-4fab-af53-4efe468e063f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:45.053979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81f491-02f4-4fab-af53-4efe468e063f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:45.086406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 23/46] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:57:44 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:46.875406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fba9e6-ca04-4037-8c43-10b6bc8a8a00 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.875944 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fba9e6-ca04-4037-8c43-10b6bc8a8a00 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.875944 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fba9e6-ca04-4037-8c43-10b6bc8a8a00 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.877312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 24/47] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:46.882847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff0af-6ead-4e2e-af5f-379623074d08 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.883239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff0af-6ead-4e2e-af5f-379623074d08 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.883534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff0af-6ead-4e2e-af5f-379623074d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.902288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c65ff0af-6ead-4e2e-af5f-379623074d08 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:46.904308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c65ff0af-6ead-4e2e-af5f-379623074d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:46.972579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 24/48] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:57:47.221947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ee2b9-f024-4b64-8be9-6721b56b6166 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.222230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ee2b9-f024-4b64-8be9-6721b56b6166 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.222501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ee2b9-f024-4b64-8be9-6721b56b6166 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.224283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 25/49] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:47.229190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51292f0-86d5-4baf-88e3-65da1dcabac5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.229484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51292f0-86d5-4baf-88e3-65da1dcabac5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.229800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51292f0-86d5-4baf-88e3-65da1dcabac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.248026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ee2b9-f024-4b64-8be9-6721b56b6166 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:47.248435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c51292f0-86d5-4baf-88e3-65da1dcabac5 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:47.250430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c51292f0-86d5-4baf-88e3-65da1dcabac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:47.321315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 25/50] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:57:47.322148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:47.354459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ee2b9-f024-4b64-8be9-6721b56b6166 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:47.386976 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46d112-4f86-4c3a-9f31-bb347818de4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:47.387606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46d112-4f86-4c3a-9f31-bb347818de4c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.387889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46d112-4f86-4c3a-9f31-bb347818de4c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.388167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46d112-4f86-4c3a-9f31-bb347818de4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.400045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46d112-4f86-4c3a-9f31-bb347818de4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0b46d112-4f86-4c3a-9f31-bb347818de4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:57:47.406170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:57:47.406971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:57:47.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 26/51] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:57:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:57:47.413058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51292f0-86d5-4baf-88e3-65da1dcabac5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:47.424780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:47.515924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51292f0-86d5-4baf-88e3-65da1dcabac5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:47.548658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c633b-6f07-44b8-a8be-ee948d198973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:47.549262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c633b-6f07-44b8-a8be-ee948d198973 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.549544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c633b-6f07-44b8-a8be-ee948d198973 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.549855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c633b-6f07-44b8-a8be-ee948d198973 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.550516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c633b-6f07-44b8-a8be-ee948d198973 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:47.550818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c633b-6f07-44b8-a8be-ee948d198973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:47.552240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c633b-6f07-44b8-a8be-ee948d198973 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:47.560120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 26/52] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:57:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:47.566394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46d112-4f86-4c3a-9f31-bb347818de4c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:47.593856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c633b-6f07-44b8-a8be-ee948d198973 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:47.664246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:47.670317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46d112-4f86-4c3a-9f31-bb347818de4c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:47.694792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c633b-6f07-44b8-a8be-ee948d198973 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:47.699880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:47.705718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aac36-16b8-4e09-ac9e-77a608ac5c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:47.706360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aac36-16b8-4e09-ac9e-77a608ac5c04 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.706647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aac36-16b8-4e09-ac9e-77a608ac5c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.706925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aac36-16b8-4e09-ac9e-77a608ac5c04 None admin] PATH_INFO: `/v3/users/42e8360255b24c6f83e6dd2dd021babf` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.708305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aac36-16b8-4e09-ac9e-77a608ac5c04 None admin] RBAC: Authorizing `identity:get_user(user_id=42e8360255b24c6f83e6dd2dd021babf)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:47.709799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aac36-16b8-4e09-ac9e-77a608ac5c04 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:47.711534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 27/53] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:57:47 2022] GET /identity/v3/users/42e8360255b24c6f83e6dd2dd021babf => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:47.716810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aac36-16b8-4e09-ac9e-77a608ac5c04 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:47.727814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc499b9-58ff-46ef-b936-85b00794e640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:47.728451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc499b9-58ff-46ef-b936-85b00794e640 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.728733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc499b9-58ff-46ef-b936-85b00794e640 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.729011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc499b9-58ff-46ef-b936-85b00794e640 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.730164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc499b9-58ff-46ef-b936-85b00794e640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:47.731638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc499b9-58ff-46ef-b936-85b00794e640 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:47.737653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 27/54] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:47.739125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc499b9-58ff-46ef-b936-85b00794e640 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:47.814171 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aac36-16b8-4e09-ac9e-77a608ac5c04 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:47.836024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc499b9-58ff-46ef-b936-85b00794e640 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:47.847932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c12920-c269-4b50-9067-7966c46fc9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:47.848573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c12920-c269-4b50-9067-7966c46fc9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.849159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c12920-c269-4b50-9067-7966c46fc9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.849443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c12920-c269-4b50-9067-7966c46fc9e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.850604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c12920-c269-4b50-9067-7966c46fc9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:47.852060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c12920-c269-4b50-9067-7966c46fc9e5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:47.853641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 28/55] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:47.859598 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c12920-c269-4b50-9067-7966c46fc9e5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:47.869487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b55c07-1397-4848-b4df-cac09a2b8f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:47.870118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55c07-1397-4848-b4df-cac09a2b8f14 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.870396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55c07-1397-4848-b4df-cac09a2b8f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.870670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55c07-1397-4848-b4df-cac09a2b8f14 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.871306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b55c07-1397-4848-b4df-cac09a2b8f14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:47.872738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b55c07-1397-4848-b4df-cac09a2b8f14 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:47.884442 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:47.900523 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 28/56] 10.222.0.50 () {60 vars in 1140 bytes} [Mon Sep 19 11:57:47 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:47.927830 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:47.965728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c12920-c269-4b50-9067-7966c46fc9e5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.001741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5ced5-3392-4cf6-b4b6-558ad935bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.002378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ced5-3392-4cf6-b4b6-558ad935bf5a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.002657 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ced5-3392-4cf6-b4b6-558ad935bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.002934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ced5-3392-4cf6-b4b6-558ad935bf5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.003669 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5ced5-3392-4cf6-b4b6-558ad935bf5a None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.domain.id=default, user.id=42e8360255b24c6f83e6dd2dd021babf) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:48.003978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5ced5-3392-4cf6-b4b6-558ad935bf5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.005438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5ced5-3392-4cf6-b4b6-558ad935bf5a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.011887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 29/57] 10.222.0.50 () {56 vars in 1322 bytes} [Mon Sep 19 11:57:47 2022] GET /identity/v3/role_assignments?user.id=42e8360255b24c6f83e6dd2dd021babf&scope.domain.id=default&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:50.062421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c78db-6e38-450d-b20f-2240d4cfae74 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:50.062920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c78db-6e38-450d-b20f-2240d4cfae74 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:50.063004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c78db-6e38-450d-b20f-2240d4cfae74 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:50.064310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 29/58] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:50.069402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32c803-9d22-4296-a653-6b64d2424d64 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:50.069846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32c803-9d22-4296-a653-6b64d2424d64 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:50.069989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32c803-9d22-4296-a653-6b64d2424d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:50.089386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8f32c803-9d22-4296-a653-6b64d2424d64 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:50.090587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8f32c803-9d22-4296-a653-6b64d2424d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:50.277847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 30/59] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:57:50.563330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c78db-6e38-450d-b20f-2240d4cfae74 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:50.660076 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c78db-6e38-450d-b20f-2240d4cfae74 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:50.693992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ba203-abc5-4483-b37b-68737e266615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:50.694617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ba203-abc5-4483-b37b-68737e266615 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:50.694898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ba203-abc5-4483-b37b-68737e266615 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:50.695173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ba203-abc5-4483-b37b-68737e266615 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:50.696279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ba203-abc5-4483-b37b-68737e266615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:50.697755 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ba203-abc5-4483-b37b-68737e266615 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:50.699318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 30/60] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:50.705289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32c803-9d22-4296-a653-6b64d2424d64 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:50.764784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:50.801448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32c803-9d22-4296-a653-6b64d2424d64 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:50.834019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99087f-2c95-4b53-bd6b-d7fdeaecf251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:50.834564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99087f-2c95-4b53-bd6b-d7fdeaecf251 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:50.834846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99087f-2c95-4b53-bd6b-d7fdeaecf251 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:50.835121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99087f-2c95-4b53-bd6b-d7fdeaecf251 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:50.835777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99087f-2c95-4b53-bd6b-d7fdeaecf251 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:50.837202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99087f-2c95-4b53-bd6b-d7fdeaecf251 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:50.863357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 31/61] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:57:50 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:54.089213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b1ee6-cfa6-41b3-ab37-17253c99c3fb None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.091712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b1ee6-cfa6-41b3-ab37-17253c99c3fb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.091712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b1ee6-cfa6-41b3-ab37-17253c99c3fb None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.091712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 31/62] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:54.097158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6efe5-329b-42f2-9d1e-2cac3881c784 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.097599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6efe5-329b-42f2-9d1e-2cac3881c784 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.097966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6efe5-329b-42f2-9d1e-2cac3881c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.120388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-15d6efe5-329b-42f2-9d1e-2cac3881c784 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:54.121603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-15d6efe5-329b-42f2-9d1e-2cac3881c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:54.228059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 32/63] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:57:54.317252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36707edd-2e7f-4c48-82f4-b4b2282467ee None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.317896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36707edd-2e7f-4c48-82f4-b4b2282467ee None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.318377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36707edd-2e7f-4c48-82f4-b4b2282467ee None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.320220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 32/64] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:54.325307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e99172-07e7-4f0e-96e7-7245b8eeef8f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.325693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e99172-07e7-4f0e-96e7-7245b8eeef8f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.326043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e99172-07e7-4f0e-96e7-7245b8eeef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.353859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e7e99172-07e7-4f0e-96e7-7245b8eeef8f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:54.354966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e7e99172-07e7-4f0e-96e7-7245b8eeef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:54.418190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:54.446645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 33/65] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:57:54.558504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36707edd-2e7f-4c48-82f4-b4b2282467ee None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:54.595681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c654fe-7bbf-465e-8f39-fcc059321780 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.596344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c654fe-7bbf-465e-8f39-fcc059321780 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.596854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c654fe-7bbf-465e-8f39-fcc059321780 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.598492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 34/66] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:57:54.604558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4035e-1d3e-49fe-be3b-87b16d6c9901 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.604810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4035e-1d3e-49fe-be3b-87b16d6c9901 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.605113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4035e-1d3e-49fe-be3b-87b16d6c9901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.627844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-13b4035e-1d3e-49fe-be3b-87b16d6c9901 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:54.629840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-13b4035e-1d3e-49fe-be3b-87b16d6c9901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:54.682956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:54.708987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 35/67] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:57:54.710798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5e0d-8780-4659-b432-337141a3934b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.711312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5e0d-8780-4659-b432-337141a3934b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.711918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5e0d-8780-4659-b432-337141a3934b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.713539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 36/68] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:54.727202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d89bb-2274-48b5-b3d8-ac4a276c8085 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.727613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d89bb-2274-48b5-b3d8-ac4a276c8085 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.728001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d89bb-2274-48b5-b3d8-ac4a276c8085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.741471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36707edd-2e7f-4c48-82f4-b4b2282467ee None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:54.760848 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6d7d89bb-2274-48b5-b3d8-ac4a276c8085 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:54.763478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6d7d89bb-2274-48b5-b3d8-ac4a276c8085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:54.809999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a44db-ccaf-437a-afab-8b44f6b51d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:54.811525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a44db-ccaf-437a-afab-8b44f6b51d0f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.813573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a44db-ccaf-437a-afab-8b44f6b51d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.814046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a44db-ccaf-437a-afab-8b44f6b51d0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.834152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a44db-ccaf-437a-afab-8b44f6b51d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-926a44db-ccaf-437a-afab-8b44f6b51d0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:57:54.840944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:57:54.841937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:57:54.842976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 33/69] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:57:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:57:54.843594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a44db-ccaf-437a-afab-8b44f6b51d0f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:54.884157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 37/70] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:57:54.886105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d89bb-2274-48b5-b3d8-ac4a276c8085 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:54.931695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:54.977800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a44db-ccaf-437a-afab-8b44f6b51d0f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:54.999645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.007376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d89bb-2274-48b5-b3d8-ac4a276c8085 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.016128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67532faf-fee3-44e8-864c-9eab32d8b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.016770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532faf-fee3-44e8-864c-9eab32d8b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.017049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532faf-fee3-44e8-864c-9eab32d8b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.017321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532faf-fee3-44e8-864c-9eab32d8b1d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.027826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67532faf-fee3-44e8-864c-9eab32d8b1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-67532faf-fee3-44e8-864c-9eab32d8b1d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:57:55.033489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:57:55.034532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:57:55.035335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 34/71] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:57:55.035946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de956d-5f0f-4cd5-a8ab-84d909bf5b56 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.036016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de956d-5f0f-4cd5-a8ab-84d909bf5b56 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.036253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de956d-5f0f-4cd5-a8ab-84d909bf5b56 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.038175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 35/72] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:55.038652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de956d-5f0f-4cd5-a8ab-84d909bf5b56 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.052066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0f445-168c-4ea1-82f4-8c47076e5a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.052687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f445-168c-4ea1-82f4-8c47076e5a2b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.052972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f445-168c-4ea1-82f4-8c47076e5a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.053250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f445-168c-4ea1-82f4-8c47076e5a2b None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.054062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0f445-168c-4ea1-82f4-8c47076e5a2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:55.054262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0f445-168c-4ea1-82f4-8c47076e5a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.055684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0f445-168c-4ea1-82f4-8c47076e5a2b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.063952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 38/73] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:57:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:55.063952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0f445-168c-4ea1-82f4-8c47076e5a2b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.147399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de956d-5f0f-4cd5-a8ab-84d909bf5b56 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.169510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.173542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0f445-168c-4ea1-82f4-8c47076e5a2b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.184968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052899a-dd23-420c-a3d2-7a3c5fb88816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.185596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052899a-dd23-420c-a3d2-7a3c5fb88816 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052899a-dd23-420c-a3d2-7a3c5fb88816 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.186286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052899a-dd23-420c-a3d2-7a3c5fb88816 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.196617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052899a-dd23-420c-a3d2-7a3c5fb88816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7052899a-dd23-420c-a3d2-7a3c5fb88816 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:57:55.201507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:57:55.202796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:57:55.203575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 36/74] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:57:55.206846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d07f-c988-47d9-a7f0-177c806c38a0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.207187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d07f-c988-47d9-a7f0-177c806c38a0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.207470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d07f-c988-47d9-a7f0-177c806c38a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.210433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59f929-46de-4098-ba29-5b08bc22375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.211053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59f929-46de-4098-ba29-5b08bc22375e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.211343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59f929-46de-4098-ba29-5b08bc22375e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.211621 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59f929-46de-4098-ba29-5b08bc22375e None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.212290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59f929-46de-4098-ba29-5b08bc22375e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:55.212596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59f929-46de-4098-ba29-5b08bc22375e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.213998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59f929-46de-4098-ba29-5b08bc22375e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.222778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 39/75] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:55.226002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b865d07f-c988-47d9-a7f0-177c806c38a0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:55.227213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b865d07f-c988-47d9-a7f0-177c806c38a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:55.228400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59f929-46de-4098-ba29-5b08bc22375e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.261270 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.293845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 37/76] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:57:55.294667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865d07f-c988-47d9-a7f0-177c806c38a0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.332458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59f929-46de-4098-ba29-5b08bc22375e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.366824 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac46f5b-de1c-4f5d-be0c-ed9fb6669b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.367457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac46f5b-de1c-4f5d-be0c-ed9fb6669b8c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.367745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac46f5b-de1c-4f5d-be0c-ed9fb6669b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.368018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac46f5b-de1c-4f5d-be0c-ed9fb6669b8c None admin] PATH_INFO: `/v3/users/9b28b915296c4aa4a1eca58ed515da05` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.384963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac46f5b-de1c-4f5d-be0c-ed9fb6669b8c None admin] RBAC: Authorizing `identity:get_user(user_id=9b28b915296c4aa4a1eca58ed515da05)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.386439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac46f5b-de1c-4f5d-be0c-ed9fb6669b8c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.388047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 40/77] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/users/9b28b915296c4aa4a1eca58ed515da05 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:55.389773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac46f5b-de1c-4f5d-be0c-ed9fb6669b8c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.398267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865d07f-c988-47d9-a7f0-177c806c38a0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.413647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.432706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ea342-5efe-4788-8abb-7cf2434776db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.433405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ea342-5efe-4788-8abb-7cf2434776db None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.433720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ea342-5efe-4788-8abb-7cf2434776db None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.433998 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ea342-5efe-4788-8abb-7cf2434776db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.444388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ea342-5efe-4788-8abb-7cf2434776db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c46ea342-5efe-4788-8abb-7cf2434776db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:57:55.449665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:57:55.450503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:57:55.451262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 38/78] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:57:55.452412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ea342-5efe-4788-8abb-7cf2434776db None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.487237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.504165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac46f5b-de1c-4f5d-be0c-ed9fb6669b8c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.541967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2e8f6-8366-43f1-978f-df5c2d2013e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.542613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e8f6-8366-43f1-978f-df5c2d2013e0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.542898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e8f6-8366-43f1-978f-df5c2d2013e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.543170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e8f6-8366-43f1-978f-df5c2d2013e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.543997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2e8f6-8366-43f1-978f-df5c2d2013e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:55.544304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2e8f6-8366-43f1-978f-df5c2d2013e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.546146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2e8f6-8366-43f1-978f-df5c2d2013e0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.554873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 41/79] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:55.560152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2e8f6-8366-43f1-978f-df5c2d2013e0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.564107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ea342-5efe-4788-8abb-7cf2434776db None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.599400 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deea1fd-4255-45f4-b75a-a2ca5d322e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.600037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deea1fd-4255-45f4-b75a-a2ca5d322e36 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.600314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deea1fd-4255-45f4-b75a-a2ca5d322e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.600584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deea1fd-4255-45f4-b75a-a2ca5d322e36 None admin] PATH_INFO: `/v3/users/42e8360255b24c6f83e6dd2dd021babf` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.601728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deea1fd-4255-45f4-b75a-a2ca5d322e36 None admin] RBAC: Authorizing `identity:get_user(user_id=42e8360255b24c6f83e6dd2dd021babf)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.603174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deea1fd-4255-45f4-b75a-a2ca5d322e36 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.604741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 39/80] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/users/42e8360255b24c6f83e6dd2dd021babf => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:55.605509 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deea1fd-4255-45f4-b75a-a2ca5d322e36 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.644483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.662156 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2e8f6-8366-43f1-978f-df5c2d2013e0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.698152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21201f07-310b-472b-b156-37dcc1f993df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.698768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201f07-310b-472b-b156-37dcc1f993df None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.699057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201f07-310b-472b-b156-37dcc1f993df None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.699333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201f07-310b-472b-b156-37dcc1f993df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.708233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.712219 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deea1fd-4255-45f4-b75a-a2ca5d322e36 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.745827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63c141-06a2-4be4-b860-6dd2d5235560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.746435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c141-06a2-4be4-b860-6dd2d5235560 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.746718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c141-06a2-4be4-b860-6dd2d5235560 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.746992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c141-06a2-4be4-b860-6dd2d5235560 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.747653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63c141-06a2-4be4-b860-6dd2d5235560 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:55.747959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63c141-06a2-4be4-b860-6dd2d5235560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.749894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63c141-06a2-4be4-b860-6dd2d5235560 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.757640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 40/81] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:55.762794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63c141-06a2-4be4-b860-6dd2d5235560 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.765558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21201f07-310b-472b-b156-37dcc1f993df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.767170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21201f07-310b-472b-b156-37dcc1f993df None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.847606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.859414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63c141-06a2-4be4-b860-6dd2d5235560 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.866309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 42/82] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:55.870952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21201f07-310b-472b-b156-37dcc1f993df None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.893740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb14f-5ced-4184-bbf1-b7662b53d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.894403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb14f-5ced-4184-bbf1-b7662b53d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.894687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb14f-5ced-4184-bbf1-b7662b53d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.894962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb14f-5ced-4184-bbf1-b7662b53d1d7 None admin] PATH_INFO: `/v3/users/9b28b915296c4aa4a1eca58ed515da05` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.896115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cb14f-5ced-4184-bbf1-b7662b53d1d7 None admin] RBAC: Authorizing `identity:get_user(user_id=9b28b915296c4aa4a1eca58ed515da05)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.897558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cb14f-5ced-4184-bbf1-b7662b53d1d7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.899161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 41/83] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/users/9b28b915296c4aa4a1eca58ed515da05 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:55.899918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb14f-5ced-4184-bbf1-b7662b53d1d7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.927437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.967159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21201f07-310b-472b-b156-37dcc1f993df None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.000743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4617d57-198c-42ba-831e-39a6a7f4a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.001183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb14f-5ced-4184-bbf1-b7662b53d1d7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.001374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617d57-198c-42ba-831e-39a6a7f4a6ac None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.001681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617d57-198c-42ba-831e-39a6a7f4a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.001959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617d57-198c-42ba-831e-39a6a7f4a6ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.003077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4617d57-198c-42ba-831e-39a6a7f4a6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.004525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4617d57-198c-42ba-831e-39a6a7f4a6ac None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.006128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 43/84] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:56.009117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4617d57-198c-42ba-831e-39a6a7f4a6ac None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.035451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb5f60-ae58-4ef7-81fa-f149294bb6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.036135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb5f60-ae58-4ef7-81fa-f149294bb6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.036484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb5f60-ae58-4ef7-81fa-f149294bb6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.036840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb5f60-ae58-4ef7-81fa-f149294bb6e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.055651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:56.103532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb5f60-ae58-4ef7-81fa-f149294bb6e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.104714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4617d57-198c-42ba-831e-39a6a7f4a6ac None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.104999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb5f60-ae58-4ef7-81fa-f149294bb6e8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.131958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:56.140216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33294fc2-5ec2-43de-92ef-32008f69352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.140852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33294fc2-5ec2-43de-92ef-32008f69352f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.141132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33294fc2-5ec2-43de-92ef-32008f69352f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.141407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33294fc2-5ec2-43de-92ef-32008f69352f None admin] PATH_INFO: `/v3/users/9b28b915296c4aa4a1eca58ed515da05` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.142565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33294fc2-5ec2-43de-92ef-32008f69352f None admin] RBAC: Authorizing `identity:get_user(user_id=9b28b915296c4aa4a1eca58ed515da05)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.143995 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33294fc2-5ec2-43de-92ef-32008f69352f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.145564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 44/85] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/users/9b28b915296c4aa4a1eca58ed515da05 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:56.146343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33294fc2-5ec2-43de-92ef-32008f69352f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.203018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 42/86] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:56.203778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb5f60-ae58-4ef7-81fa-f149294bb6e8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.246138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33294fc2-5ec2-43de-92ef-32008f69352f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.263644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:56.281288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fb108-2504-44a8-afbb-293a168def83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.281955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fb108-2504-44a8-afbb-293a168def83 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.282238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fb108-2504-44a8-afbb-293a168def83 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.282511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fb108-2504-44a8-afbb-293a168def83 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.283638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fb108-2504-44a8-afbb-293a168def83 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.285073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fb108-2504-44a8-afbb-293a168def83 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.286726 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 45/87] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:56.287456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fb108-2504-44a8-afbb-293a168def83 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.303782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb5f60-ae58-4ef7-81fa-f149294bb6e8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.330356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:56.337985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3729d-d63d-4f1b-8b83-283e7f72246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.338591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3729d-d63d-4f1b-8b83-283e7f72246e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.338868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3729d-d63d-4f1b-8b83-283e7f72246e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.339135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3729d-d63d-4f1b-8b83-283e7f72246e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.384693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fb108-2504-44a8-afbb-293a168def83 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.407762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3729d-d63d-4f1b-8b83-283e7f72246e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.409244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3729d-d63d-4f1b-8b83-283e7f72246e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.419291 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb391c-65d7-4c33-8d82-256dc73a2f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.419898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb391c-65d7-4c33-8d82-256dc73a2f47 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.420778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb391c-65d7-4c33-8d82-256dc73a2f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.421254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb391c-65d7-4c33-8d82-256dc73a2f47 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.421928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb391c-65d7-4c33-8d82-256dc73a2f47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.423352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb391c-65d7-4c33-8d82-256dc73a2f47 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.444994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 46/88] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:57:56 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:56.445844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb391c-65d7-4c33-8d82-256dc73a2f47 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.497298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:56.523460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 43/89] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:56.524669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3729d-d63d-4f1b-8b83-283e7f72246e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.554448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:56.573214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb391c-65d7-4c33-8d82-256dc73a2f47 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.615543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72f8aa-a46b-4568-92c1-81b39cbc31cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.616164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72f8aa-a46b-4568-92c1-81b39cbc31cf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.616446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72f8aa-a46b-4568-92c1-81b39cbc31cf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.616975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72f8aa-a46b-4568-92c1-81b39cbc31cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.641146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3729d-d63d-4f1b-8b83-283e7f72246e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.686389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472dfb-e60b-4745-86db-90ff0432e002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.686971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472dfb-e60b-4745-86db-90ff0432e002 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.687254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472dfb-e60b-4745-86db-90ff0432e002 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.687529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472dfb-e60b-4745-86db-90ff0432e002 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.688733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94472dfb-e60b-4745-86db-90ff0432e002 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.690546 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94472dfb-e60b-4745-86db-90ff0432e002 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.692263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 44/90] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:56.695285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72f8aa-a46b-4568-92c1-81b39cbc31cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.696769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72f8aa-a46b-4568-92c1-81b39cbc31cf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.698041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472dfb-e60b-4745-86db-90ff0432e002 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.750192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:56.824449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 47/91] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:56.825309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72f8aa-a46b-4568-92c1-81b39cbc31cf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.827247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472dfb-e60b-4745-86db-90ff0432e002 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.836952 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:56.872045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedf3f0-3813-412d-a70a-5b0d842a97b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.873265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedf3f0-3813-412d-a70a-5b0d842a97b1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.873740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedf3f0-3813-412d-a70a-5b0d842a97b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.874437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedf3f0-3813-412d-a70a-5b0d842a97b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.875585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedf3f0-3813-412d-a70a-5b0d842a97b1 None admin] RBAC: Adding query filter params (role.id=b320236412e649d9ab1e6787ef8a6870, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb, user.id=9b28b915296c4aa4a1eca58ed515da05) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:56.876036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedf3f0-3813-412d-a70a-5b0d842a97b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.878192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedf3f0-3813-412d-a70a-5b0d842a97b1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.886923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 45/92] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/role_assignments?user.id=9b28b915296c4aa4a1eca58ed515da05&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:56.888509 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedf3f0-3813-412d-a70a-5b0d842a97b1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.947538 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72f8aa-a46b-4568-92c1-81b39cbc31cf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:57.022247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9471c2b-4b36-403e-8446-5a345c24a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:57.023145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9471c2b-4b36-403e-8446-5a345c24a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:57.023580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9471c2b-4b36-403e-8446-5a345c24a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:57.024014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9471c2b-4b36-403e-8446-5a345c24a0e5 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:57.026780 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9471c2b-4b36-403e-8446-5a345c24a0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:57.030146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9471c2b-4b36-403e-8446-5a345c24a0e5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:57.032968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 48/93] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:57.034755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9471c2b-4b36-403e-8446-5a345c24a0e5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:57.051712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedf3f0-3813-412d-a70a-5b0d842a97b1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:57.065047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:57.121071 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99643e-f138-46cc-9c1e-8f079c9c82c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:57.121961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99643e-f138-46cc-9c1e-8f079c9c82c3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:57.125154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99643e-f138-46cc-9c1e-8f079c9c82c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:57.125588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99643e-f138-46cc-9c1e-8f079c9c82c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:57.126501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99643e-f138-46cc-9c1e-8f079c9c82c3 None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb, user.id=42e8360255b24c6f83e6dd2dd021babf) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:57.126973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99643e-f138-46cc-9c1e-8f079c9c82c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:57.128460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99643e-f138-46cc-9c1e-8f079c9c82c3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:57.134583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 46/94] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/role_assignments?user.id=42e8360255b24c6f83e6dd2dd021babf&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:57.135429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99643e-f138-46cc-9c1e-8f079c9c82c3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:57.166305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:57.211892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9471c2b-4b36-403e-8446-5a345c24a0e5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:57.260725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c2bf3-91a0-4324-92f7-bef3aad22b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:57.261372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c2bf3-91a0-4324-92f7-bef3aad22b53 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:57.261666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c2bf3-91a0-4324-92f7-bef3aad22b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:57.261954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c2bf3-91a0-4324-92f7-bef3aad22b53 None admin] PATH_INFO: `/v3/projects/6167aa45b8ed4061b12dfc0a65aedf57` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:57.266874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c2bf3-91a0-4324-92f7-bef3aad22b53 None admin] RBAC: Authorizing `identity:get_project(project_id=6167aa45b8ed4061b12dfc0a65aedf57)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:57.268785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c2bf3-91a0-4324-92f7-bef3aad22b53 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:57.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 49/95] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:57:57 2022] GET /identity/v3/projects/6167aa45b8ed4061b12dfc0a65aedf57 => generated 312 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:57.275872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99643e-f138-46cc-9c1e-8f079c9c82c3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:57.276773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c2bf3-91a0-4324-92f7-bef3aad22b53 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:57.319655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b480ff-1431-468d-a579-911b8400064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:57.320276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b480ff-1431-468d-a579-911b8400064f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:57.320552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b480ff-1431-468d-a579-911b8400064f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:57.321352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b480ff-1431-468d-a579-911b8400064f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:57.322113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b480ff-1431-468d-a579-911b8400064f None admin] RBAC: Adding query filter params (role.id=c59031d5db354a478ab7a9ac0000e098, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb, user.id=9b28b915296c4aa4a1eca58ed515da05) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:57.322424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b480ff-1431-468d-a579-911b8400064f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:57.323899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b480ff-1431-468d-a579-911b8400064f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:57.335982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 47/96] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:57:57 2022] GET /identity/v3/role_assignments?user.id=9b28b915296c4aa4a1eca58ed515da05&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=c59031d5db354a478ab7a9ac0000e098 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:57.424238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:57.451794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c2bf3-91a0-4324-92f7-bef3aad22b53 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:57.497277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883bf0-24dd-401f-a8d0-bfc7ded65f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:57.497935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883bf0-24dd-401f-a8d0-bfc7ded65f4a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:57.498316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883bf0-24dd-401f-a8d0-bfc7ded65f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:57.498764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883bf0-24dd-401f-a8d0-bfc7ded65f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:57.499574 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883bf0-24dd-401f-a8d0-bfc7ded65f4a None admin] RBAC: Adding query filter params (role.id=b320236412e649d9ab1e6787ef8a6870, scope.project.id=6167aa45b8ed4061b12dfc0a65aedf57, user.id=9b28b915296c4aa4a1eca58ed515da05) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:57.499888 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883bf0-24dd-401f-a8d0-bfc7ded65f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:57.501406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883bf0-24dd-401f-a8d0-bfc7ded65f4a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:57.507883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 50/97] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:57:57 2022] GET /identity/v3/role_assignments?user.id=9b28b915296c4aa4a1eca58ed515da05&scope.project.id=6167aa45b8ed4061b12dfc0a65aedf57&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:59.477593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cfd0d-bd83-436b-85f3-7fb01cae3039 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.478115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cfd0d-bd83-436b-85f3-7fb01cae3039 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.478222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cfd0d-bd83-436b-85f3-7fb01cae3039 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.479516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 48/98] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:59.485525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7119d60-2c11-4136-95fd-df0b6a36225c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.485967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7119d60-2c11-4136-95fd-df0b6a36225c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.486163 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7119d60-2c11-4136-95fd-df0b6a36225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.504443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d7119d60-2c11-4136-95fd-df0b6a36225c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:59.505635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d7119d60-2c11-4136-95fd-df0b6a36225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:59.590990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 51/99] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:00.010078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cfd0d-bd83-436b-85f3-7fb01cae3039 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:00.020805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1dff-6a31-4836-b884-8387d514e1e8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.021112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1dff-6a31-4836-b884-8387d514e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.021353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1dff-6a31-4836-b884-8387d514e1e8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.022864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 52/100] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:00.029650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65cf8-5c7f-4129-9359-c499b9339d80 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.029939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65cf8-5c7f-4129-9359-c499b9339d80 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.030234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65cf8-5c7f-4129-9359-c499b9339d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.068964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8af65cf8-5c7f-4129-9359-c499b9339d80 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:00.078573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8af65cf8-5c7f-4129-9359-c499b9339d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:00.178952 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:00.190347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cfd0d-bd83-436b-85f3-7fb01cae3039 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:00.240821 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 53/101] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:00.246480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608add6-fe9a-482c-a361-de3faa892edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:00.246795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669881a1-0732-4eb3-9212-26ac6f355bea None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.247124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608add6-fe9a-482c-a361-de3faa892edb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.247412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608add6-fe9a-482c-a361-de3faa892edb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.247690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608add6-fe9a-482c-a361-de3faa892edb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.247885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669881a1-0732-4eb3-9212-26ac6f355bea None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.248381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669881a1-0732-4eb3-9212-26ac6f355bea None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.249197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608add6-fe9a-482c-a361-de3faa892edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:00.250144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 54/102] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:00.251336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608add6-fe9a-482c-a361-de3faa892edb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:00.257647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 49/103] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:00.258626 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669881a1-0732-4eb3-9212-26ac6f355bea None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:00.259977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4a96-579f-4a7c-ab8f-939720322527 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.260473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4a96-579f-4a7c-ab8f-939720322527 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.260900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4a96-579f-4a7c-ab8f-939720322527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.261930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:00.298972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-832d4a96-579f-4a7c-ab8f-939720322527 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:00.300490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-832d4a96-579f-4a7c-ab8f-939720322527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:00.426940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669881a1-0732-4eb3-9212-26ac6f355bea None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:00.454366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 50/104] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:00.489346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6c124-58f4-4f86-86fb-a9ae8369752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:00.494075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c124-58f4-4f86-86fb-a9ae8369752b None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.494370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c124-58f4-4f86-86fb-a9ae8369752b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.494656 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c124-58f4-4f86-86fb-a9ae8369752b None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.495330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6c124-58f4-4f86-86fb-a9ae8369752b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:00.496803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6c124-58f4-4f86-86fb-a9ae8369752b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:00.527222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 55/105] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:58:00 2022] POST /identity/v3/projects => generated 302 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:58:00.577049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2d0f-b0ee-404c-a4ad-334911dad6c1 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.578169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2d0f-b0ee-404c-a4ad-334911dad6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.578641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2d0f-b0ee-404c-a4ad-334911dad6c1 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.580649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 51/106] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:00.586805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4fd07-27fd-4851-b1af-8e861f17710f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.587420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4fd07-27fd-4851-b1af-8e861f17710f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.587878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4fd07-27fd-4851-b1af-8e861f17710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.610033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-08f4fd07-27fd-4851-b1af-8e861f17710f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:00.611659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-08f4fd07-27fd-4851-b1af-8e861f17710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:00.624599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfb3a5-d598-450b-a52c-ae2464d102e8 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.624995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfb3a5-d598-450b-a52c-ae2464d102e8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.625567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfb3a5-d598-450b-a52c-ae2464d102e8 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.627234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 52/107] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:00.632820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82510612-5242-4846-b1ec-b238c768f7db None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.633204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82510612-5242-4846-b1ec-b238c768f7db None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.633570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82510612-5242-4846-b1ec-b238c768f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.690302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-82510612-5242-4846-b1ec-b238c768f7db None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:00.698214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-82510612-5242-4846-b1ec-b238c768f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:00.709962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:00.754361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 56/108] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:00.755838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f3f08-5fad-4fff-a2e8-b5f6ce78b9a9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.756132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f3f08-5fad-4fff-a2e8-b5f6ce78b9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.756412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f3f08-5fad-4fff-a2e8-b5f6ce78b9a9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.758046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 57/109] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:00.763296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f3f08-5fad-4fff-a2e8-b5f6ce78b9a9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:00.843202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 53/110] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:00.844981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100316a3-5843-472a-a08d-0f7883e68c94 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:00.845278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100316a3-5843-472a-a08d-0f7883e68c94 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:00.845564 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100316a3-5843-472a-a08d-0f7883e68c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:00.868704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-100316a3-5843-472a-a08d-0f7883e68c94 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:00.868880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-100316a3-5843-472a-a08d-0f7883e68c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:00.881269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:00.942985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f3f08-5fad-4fff-a2e8-b5f6ce78b9a9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:00.982002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 54/111] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:00.984268 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100316a3-5843-472a-a08d-0f7883e68c94 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.010986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359ee52-14f7-415e-9b87-f6826450103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.011685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359ee52-14f7-415e-9b87-f6826450103a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.012030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359ee52-14f7-415e-9b87-f6826450103a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.012314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359ee52-14f7-415e-9b87-f6826450103a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.035771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359ee52-14f7-415e-9b87-f6826450103a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e359ee52-14f7-415e-9b87-f6826450103a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:01.049513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:01.050393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:01.051154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 58/112] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:01.058260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359ee52-14f7-415e-9b87-f6826450103a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.146106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:01.172222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100316a3-5843-472a-a08d-0f7883e68c94 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:01.225562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359ee52-14f7-415e-9b87-f6826450103a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:01.225761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb230ce-364e-4856-89f3-5eef39d19bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.226305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb230ce-364e-4856-89f3-5eef39d19bee None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.226592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb230ce-364e-4856-89f3-5eef39d19bee None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.227110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb230ce-364e-4856-89f3-5eef39d19bee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.241694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb230ce-364e-4856-89f3-5eef39d19bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4bb230ce-364e-4856-89f3-5eef39d19bee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:01.248896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:01.249772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:01.250515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 55/113] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:01.251624 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb230ce-364e-4856-89f3-5eef39d19bee None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.267239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:01.267492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e6087-766e-484c-9740-d57368cf8e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.268807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e6087-766e-484c-9740-d57368cf8e99 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.269096 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e6087-766e-484c-9740-d57368cf8e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.269377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e6087-766e-484c-9740-d57368cf8e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.270175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e6087-766e-484c-9740-d57368cf8e99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:01.270484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e6087-766e-484c-9740-d57368cf8e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:01.272078 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e6087-766e-484c-9740-d57368cf8e99 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:01.283715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 59/114] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:01.284664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e6087-766e-484c-9740-d57368cf8e99 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.372863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb230ce-364e-4856-89f3-5eef39d19bee None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:01.401696 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e6087-766e-484c-9740-d57368cf8e99 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:01.409606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:01.412301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123b7a3-e336-4a6d-a40e-675cb2960c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.412939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123b7a3-e336-4a6d-a40e-675cb2960c2d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.413218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123b7a3-e336-4a6d-a40e-675cb2960c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.413489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123b7a3-e336-4a6d-a40e-675cb2960c2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.424596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123b7a3-e336-4a6d-a40e-675cb2960c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-9123b7a3-e336-4a6d-a40e-675cb2960c2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:01.429438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:01.430314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:01.431063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 56/115] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:01.436419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123b7a3-e336-4a6d-a40e-675cb2960c2d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.441224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84249944-3282-47af-bf57-50a9a7dc1dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.441894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84249944-3282-47af-bf57-50a9a7dc1dcd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.442183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84249944-3282-47af-bf57-50a9a7dc1dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.442467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84249944-3282-47af-bf57-50a9a7dc1dcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.454365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84249944-3282-47af-bf57-50a9a7dc1dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-84249944-3282-47af-bf57-50a9a7dc1dcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:01.460356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:01.461224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:01.462046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 60/116] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:01.462732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84249944-3282-47af-bf57-50a9a7dc1dcd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.523392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:01.563435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123b7a3-e336-4a6d-a40e-675cb2960c2d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:01.568711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84249944-3282-47af-bf57-50a9a7dc1dcd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:01.600865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fa030-47fa-410f-ba98-32b5266a424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.601585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fa030-47fa-410f-ba98-32b5266a424b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.601794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fa030-47fa-410f-ba98-32b5266a424b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.602073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fa030-47fa-410f-ba98-32b5266a424b None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.602744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fa030-47fa-410f-ba98-32b5266a424b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:01.603051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fa030-47fa-410f-ba98-32b5266a424b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:01.604442 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fa030-47fa-410f-ba98-32b5266a424b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:01.604751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a499b39-9331-4a22-92aa-63ce315bbbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.605409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a499b39-9331-4a22-92aa-63ce315bbbef None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.605724 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a499b39-9331-4a22-92aa-63ce315bbbef None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.605997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a499b39-9331-4a22-92aa-63ce315bbbef None admin] PATH_INFO: `/v3/users/42e8360255b24c6f83e6dd2dd021babf` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.607108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a499b39-9331-4a22-92aa-63ce315bbbef None admin] RBAC: Authorizing `identity:get_user(user_id=42e8360255b24c6f83e6dd2dd021babf)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:01.608601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a499b39-9331-4a22-92aa-63ce315bbbef None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:01.610229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 61/117] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/users/42e8360255b24c6f83e6dd2dd021babf => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:01.614547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 57/118] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:01.615661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fa030-47fa-410f-ba98-32b5266a424b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.615867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a499b39-9331-4a22-92aa-63ce315bbbef None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.657781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:01.732721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fa030-47fa-410f-ba98-32b5266a424b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:01.733080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a499b39-9331-4a22-92aa-63ce315bbbef None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:01.760834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:01.768875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120100d1-d2a7-40b6-b433-07fc243a21e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.769520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120100d1-d2a7-40b6-b433-07fc243a21e9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.769828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120100d1-d2a7-40b6-b433-07fc243a21e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.770105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120100d1-d2a7-40b6-b433-07fc243a21e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.770802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc06be-c31e-4b73-9c82-7feb742a7da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.771412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc06be-c31e-4b73-9c82-7feb742a7da9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.771698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc06be-c31e-4b73-9c82-7feb742a7da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.772069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc06be-c31e-4b73-9c82-7feb742a7da9 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.772635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc06be-c31e-4b73-9c82-7feb742a7da9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:01.772943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc06be-c31e-4b73-9c82-7feb742a7da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:01.774361 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc06be-c31e-4b73-9c82-7feb742a7da9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:01.781336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120100d1-d2a7-40b6-b433-07fc243a21e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:01.782260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 58/119] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:01.787034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc06be-c31e-4b73-9c82-7feb742a7da9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-120100d1-d2a7-40b6-b433-07fc243a21e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:01.787148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:01.788242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:01.789344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 62/120] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:01.793023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120100d1-d2a7-40b6-b433-07fc243a21e9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.889173 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:01.896398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120100d1-d2a7-40b6-b433-07fc243a21e9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:01.898716 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc06be-c31e-4b73-9c82-7feb742a7da9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:01.935737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e236ca-9554-47de-ad61-f84eea196171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.936432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e236ca-9554-47de-ad61-f84eea196171 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.936722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e236ca-9554-47de-ad61-f84eea196171 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.937320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e236ca-9554-47de-ad61-f84eea196171 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.938493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e236ca-9554-47de-ad61-f84eea196171 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:01.940018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e236ca-9554-47de-ad61-f84eea196171 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:01.941839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 63/121] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:01.942441 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e236ca-9554-47de-ad61-f84eea196171 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:01.946562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574678c0-6f22-4c59-a379-c7fd4e632668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:01.947099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574678c0-6f22-4c59-a379-c7fd4e632668 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.947391 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574678c0-6f22-4c59-a379-c7fd4e632668 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.947672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574678c0-6f22-4c59-a379-c7fd4e632668 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.948348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574678c0-6f22-4c59-a379-c7fd4e632668 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:01.948658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574678c0-6f22-4c59-a379-c7fd4e632668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:01.950064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574678c0-6f22-4c59-a379-c7fd4e632668 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:01.958438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 59/122] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:01.963790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574678c0-6f22-4c59-a379-c7fd4e632668 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:02.021045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:02.051310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e236ca-9554-47de-ad61-f84eea196171 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:02.073720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574678c0-6f22-4c59-a379-c7fd4e632668 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:02.087545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba82015-84f8-4f9b-a2be-733d273f16c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:02.088177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba82015-84f8-4f9b-a2be-733d273f16c3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:02.088656 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba82015-84f8-4f9b-a2be-733d273f16c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:02.088761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba82015-84f8-4f9b-a2be-733d273f16c3 None admin] PATH_INFO: `/v3/users/dd3511d7acd648a2b9ebd696a1ef34bc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:02.103691 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba82015-84f8-4f9b-a2be-733d273f16c3 None admin] RBAC: Authorizing `identity:get_user(user_id=dd3511d7acd648a2b9ebd696a1ef34bc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:02.105163 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba82015-84f8-4f9b-a2be-733d273f16c3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:02.106954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 64/123] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/users/dd3511d7acd648a2b9ebd696a1ef34bc => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:02.107672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba82015-84f8-4f9b-a2be-733d273f16c3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:02.113841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ca2c-1a3d-428f-a6e2-ed8de0504adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:02.114488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ca2c-1a3d-428f-a6e2-ed8de0504adc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:02.114814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ca2c-1a3d-428f-a6e2-ed8de0504adc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:02.115070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ca2c-1a3d-428f-a6e2-ed8de0504adc None admin] PATH_INFO: `/v3/users/9b28b915296c4aa4a1eca58ed515da05` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:02.116214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079ca2c-1a3d-428f-a6e2-ed8de0504adc None admin] RBAC: Authorizing `identity:get_user(user_id=9b28b915296c4aa4a1eca58ed515da05)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:02.117687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079ca2c-1a3d-428f-a6e2-ed8de0504adc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:02.119383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 60/124] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:01 2022] GET /identity/v3/users/9b28b915296c4aa4a1eca58ed515da05 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:02.119992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ca2c-1a3d-428f-a6e2-ed8de0504adc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:02.136179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:02.225712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ca2c-1a3d-428f-a6e2-ed8de0504adc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:02.226014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba82015-84f8-4f9b-a2be-733d273f16c3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:02.252588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:02.260136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f43131-a3ca-4223-bbe1-87c49ee0f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:02.260753 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43131-a3ca-4223-bbe1-87c49ee0f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:02.261038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43131-a3ca-4223-bbe1-87c49ee0f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:02.261309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43131-a3ca-4223-bbe1-87c49ee0f4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:02.262001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f43131-a3ca-4223-bbe1-87c49ee0f4c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:02.262306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f43131-a3ca-4223-bbe1-87c49ee0f4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:02.264317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f43131-a3ca-4223-bbe1-87c49ee0f4c7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:02.267306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493fbe0-174e-488f-9f92-066447e8a59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:02.267968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fbe0-174e-488f-9f92-066447e8a59a None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:02.268257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fbe0-174e-488f-9f92-066447e8a59a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:02.268538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fbe0-174e-488f-9f92-066447e8a59a None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/users/42e8360255b24c6f83e6dd2dd021babf/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:02.271526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493fbe0-174e-488f-9f92-066447e8a59a None admin] RBAC: Authorizing `identity:create_grant(project_id=4b294bc0bf21460b92e0270a4e59e9eb, user_id=42e8360255b24c6f83e6dd2dd021babf, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:02.276889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 65/125] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:02.277014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493fbe0-174e-488f-9f92-066447e8a59a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:02.277087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f43131-a3ca-4223-bbe1-87c49ee0f4c7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:02.289668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 61/126] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:58:02 2022] PUT /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/users/42e8360255b24c6f83e6dd2dd021babf/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:02.291348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493fbe0-174e-488f-9f92-066447e8a59a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:02.382449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:02.413594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f43131-a3ca-4223-bbe1-87c49ee0f4c7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:02.434015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493fbe0-174e-488f-9f92-066447e8a59a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:02.461109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d17af-2aae-4ce5-9f8b-76006689bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:02.462349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d17af-2aae-4ce5-9f8b-76006689bd4a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:02.462833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d17af-2aae-4ce5-9f8b-76006689bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:02.463305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d17af-2aae-4ce5-9f8b-76006689bd4a None admin] PATH_INFO: `/v3/users/9b28b915296c4aa4a1eca58ed515da05` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:02.464940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d17af-2aae-4ce5-9f8b-76006689bd4a None admin] RBAC: Authorizing `identity:get_user(user_id=9b28b915296c4aa4a1eca58ed515da05)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:02.467141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d17af-2aae-4ce5-9f8b-76006689bd4a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:02.469553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 66/127] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:02 2022] GET /identity/v3/users/9b28b915296c4aa4a1eca58ed515da05 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:02.470554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d17af-2aae-4ce5-9f8b-76006689bd4a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:02.480352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d70849-47cd-4f57-87c2-1b339ed9fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:02.480911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70849-47cd-4f57-87c2-1b339ed9fad1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:02.481198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70849-47cd-4f57-87c2-1b339ed9fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:02.481477 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70849-47cd-4f57-87c2-1b339ed9fad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:02.546222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:02.573638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d70849-47cd-4f57-87c2-1b339ed9fad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:02.576700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d70849-47cd-4f57-87c2-1b339ed9fad1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:02.594948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d17af-2aae-4ce5-9f8b-76006689bd4a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:02.632601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668976f-ddb8-4115-8356-0fda0c937cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:02.633239 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668976f-ddb8-4115-8356-0fda0c937cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:02.633520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668976f-ddb8-4115-8356-0fda0c937cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:02.633839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668976f-ddb8-4115-8356-0fda0c937cf9 None admin] PATH_INFO: `/v3/projects/6167aa45b8ed4061b12dfc0a65aedf57` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:02.634960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668976f-ddb8-4115-8356-0fda0c937cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=6167aa45b8ed4061b12dfc0a65aedf57)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:02.636412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668976f-ddb8-4115-8356-0fda0c937cf9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:02.638056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 67/128] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:02 2022] GET /identity/v3/projects/6167aa45b8ed4061b12dfc0a65aedf57 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:02.642567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668976f-ddb8-4115-8356-0fda0c937cf9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:02.670891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:02.710437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 62/129] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:02.711667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d70849-47cd-4f57-87c2-1b339ed9fad1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:02.786383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668976f-ddb8-4115-8356-0fda0c937cf9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:02.803593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:02.824514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae820b-cd7f-4f8d-a762-9ea296488d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:02.825854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae820b-cd7f-4f8d-a762-9ea296488d9a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:02.826764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae820b-cd7f-4f8d-a762-9ea296488d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:02.827138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae820b-cd7f-4f8d-a762-9ea296488d9a None admin] PATH_INFO: `/v3/users/9b28b915296c4aa4a1eca58ed515da05` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:02.828547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae820b-cd7f-4f8d-a762-9ea296488d9a None admin] RBAC: Authorizing `identity:get_user(user_id=9b28b915296c4aa4a1eca58ed515da05)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:02.830240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae820b-cd7f-4f8d-a762-9ea296488d9a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:02.836809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d70849-47cd-4f57-87c2-1b339ed9fad1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:02.837031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 68/130] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:02 2022] GET /identity/v3/users/9b28b915296c4aa4a1eca58ed515da05 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:02.837031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae820b-cd7f-4f8d-a762-9ea296488d9a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:02.893799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e579e-7a12-48d1-b377-49bb9cdfe88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:02.894677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e579e-7a12-48d1-b377-49bb9cdfe88a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:02.895101 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e579e-7a12-48d1-b377-49bb9cdfe88a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:02.895544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e579e-7a12-48d1-b377-49bb9cdfe88a None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:02.897346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e579e-7a12-48d1-b377-49bb9cdfe88a None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:02.899508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e579e-7a12-48d1-b377-49bb9cdfe88a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:02.902519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 63/131] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:02 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:02.903432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e579e-7a12-48d1-b377-49bb9cdfe88a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:02.939830 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:02.956329 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae820b-cd7f-4f8d-a762-9ea296488d9a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:02.991404 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a6478-5161-4701-8cfe-c47b80b8fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:02.992063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a6478-5161-4701-8cfe-c47b80b8fcce None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:02.992344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a6478-5161-4701-8cfe-c47b80b8fcce None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:02.992619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a6478-5161-4701-8cfe-c47b80b8fcce None admin] PATH_INFO: `/v3/projects/6167aa45b8ed4061b12dfc0a65aedf57/users/9b28b915296c4aa4a1eca58ed515da05/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:02.994544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a6478-5161-4701-8cfe-c47b80b8fcce None admin] RBAC: Authorizing `identity:create_grant(project_id=6167aa45b8ed4061b12dfc0a65aedf57, user_id=9b28b915296c4aa4a1eca58ed515da05, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:02.996005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a6478-5161-4701-8cfe-c47b80b8fcce None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:03.011284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 69/132] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:58:02 2022] PUT /identity/v3/projects/6167aa45b8ed4061b12dfc0a65aedf57/users/9b28b915296c4aa4a1eca58ed515da05/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:03.012110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a6478-5161-4701-8cfe-c47b80b8fcce None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:03.037159 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e579e-7a12-48d1-b377-49bb9cdfe88a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:03.079384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e5b8-4be5-455e-a8d5-7e47f5d2b848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:03.080043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e5b8-4be5-455e-a8d5-7e47f5d2b848 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:03.080322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e5b8-4be5-455e-a8d5-7e47f5d2b848 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:03.080594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12e5b8-4be5-455e-a8d5-7e47f5d2b848 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:03.082003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e5b8-4be5-455e-a8d5-7e47f5d2b848 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:03.083495 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12e5b8-4be5-455e-a8d5-7e47f5d2b848 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:03.085472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 64/133] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:02 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:03.086059 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e5b8-4be5-455e-a8d5-7e47f5d2b848 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:03.115222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:03.176276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a6478-5161-4701-8cfe-c47b80b8fcce None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:03.216606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12e5b8-4be5-455e-a8d5-7e47f5d2b848 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:03.227605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc7229-6d91-4b33-8bd6-b79f1d676572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:03.228915 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7229-6d91-4b33-8bd6-b79f1d676572 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:03.229203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7229-6d91-4b33-8bd6-b79f1d676572 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:03.229819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7229-6d91-4b33-8bd6-b79f1d676572 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:03.231167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc7229-6d91-4b33-8bd6-b79f1d676572 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:03.234175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc7229-6d91-4b33-8bd6-b79f1d676572 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:03.236397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 70/134] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:03 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:03.237503 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148f6f-fabb-4636-a2a3-802347b02aa4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:03.237816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148f6f-fabb-4636-a2a3-802347b02aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:03.238093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148f6f-fabb-4636-a2a3-802347b02aa4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:03.239592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 71/135] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:03.240308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148f6f-fabb-4636-a2a3-802347b02aa4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:03.262686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:03.268083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b4eb4-e94b-4e73-aead-d652a75451c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:03.269215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b4eb4-e94b-4e73-aead-d652a75451c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:03.269504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b4eb4-e94b-4e73-aead-d652a75451c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:03.269813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b4eb4-e94b-4e73-aead-d652a75451c0 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/users/9b28b915296c4aa4a1eca58ed515da05/roles/c59031d5db354a478ab7a9ac0000e098` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:03.272268 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b4eb4-e94b-4e73-aead-d652a75451c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b294bc0bf21460b92e0270a4e59e9eb, user_id=9b28b915296c4aa4a1eca58ed515da05, role_id=c59031d5db354a478ab7a9ac0000e098)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:03.274114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b4eb4-e94b-4e73-aead-d652a75451c0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:03.290134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 65/136] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:58:03 2022] PUT /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/users/9b28b915296c4aa4a1eca58ed515da05/roles/c59031d5db354a478ab7a9ac0000e098 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:03.291830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b4eb4-e94b-4e73-aead-d652a75451c0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:03.376193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148f6f-fabb-4636-a2a3-802347b02aa4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:03.405779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:03.423031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc5fcd-f4b7-4bde-8a63-ad88b14a3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:03.424045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5fcd-f4b7-4bde-8a63-ad88b14a3b7b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:03.424575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5fcd-f4b7-4bde-8a63-ad88b14a3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:03.425061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5fcd-f4b7-4bde-8a63-ad88b14a3b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:03.426025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc5fcd-f4b7-4bde-8a63-ad88b14a3b7b None admin] RBAC: Adding query filter params (role.id=882e144ddabb436ba7e9c2130cf9cb49, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb, user.id=dd3511d7acd648a2b9ebd696a1ef34bc) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:03.426737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc5fcd-f4b7-4bde-8a63-ad88b14a3b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:03.429069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc5fcd-f4b7-4bde-8a63-ad88b14a3b7b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:03.433984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b4eb4-e94b-4e73-aead-d652a75451c0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:03.436013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 72/137] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:03 2022] GET /identity/v3/role_assignments?user.id=dd3511d7acd648a2b9ebd696a1ef34bc&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=882e144ddabb436ba7e9c2130cf9cb49 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:03.438721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4574-5b30-49b0-9d59-217c62b8f2d0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:03.439254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4574-5b30-49b0-9d59-217c62b8f2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:03.439769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde4574-5b30-49b0-9d59-217c62b8f2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:03.475432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ddde4574-5b30-49b0-9d59-217c62b8f2d0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:03.477175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ddde4574-5b30-49b0-9d59-217c62b8f2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:03.511324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc38de-728f-43a5-889f-5bc21936f407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:03.513364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc38de-728f-43a5-889f-5bc21936f407 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:03.514606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc38de-728f-43a5-889f-5bc21936f407 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:03.515353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc38de-728f-43a5-889f-5bc21936f407 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/users/9b28b915296c4aa4a1eca58ed515da05/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:03.520372 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc38de-728f-43a5-889f-5bc21936f407 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b294bc0bf21460b92e0270a4e59e9eb, user_id=9b28b915296c4aa4a1eca58ed515da05, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:03.522472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc38de-728f-43a5-889f-5bc21936f407 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:03.552298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 66/138] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:58:03 2022] PUT /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/users/9b28b915296c4aa4a1eca58ed515da05/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:03.606477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 73/139] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:03.970082 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc38de-728f-43a5-889f-5bc21936f407 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:04.103431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc38de-728f-43a5-889f-5bc21936f407 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:04.138269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fff7e-8469-4695-8f06-8356f0ad538f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:04.139593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fff7e-8469-4695-8f06-8356f0ad538f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:04.139879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fff7e-8469-4695-8f06-8356f0ad538f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:04.140153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fff7e-8469-4695-8f06-8356f0ad538f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:04.141286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fff7e-8469-4695-8f06-8356f0ad538f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:04.142768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fff7e-8469-4695-8f06-8356f0ad538f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:04.144346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 67/140] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:04.149860 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde4574-5b30-49b0-9d59-217c62b8f2d0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:04.166342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:04.281757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde4574-5b30-49b0-9d59-217c62b8f2d0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:04.317276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c236dd-2887-4afa-89c5-edae72563855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:04.317928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c236dd-2887-4afa-89c5-edae72563855 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:04.318208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c236dd-2887-4afa-89c5-edae72563855 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:04.318477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c236dd-2887-4afa-89c5-edae72563855 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:04.319131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c236dd-2887-4afa-89c5-edae72563855 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:04.320559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c236dd-2887-4afa-89c5-edae72563855 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:04.343220 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 74/141] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:58:04 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:05.202985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b045-920d-4898-b18b-64cd502d4252 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:05.203510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b045-920d-4898-b18b-64cd502d4252 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:05.203510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b045-920d-4898-b18b-64cd502d4252 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:05.204955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 68/142] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:05.210603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54449030-cc5f-445b-97f7-8119cee1178d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:05.211042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54449030-cc5f-445b-97f7-8119cee1178d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:05.211219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54449030-cc5f-445b-97f7-8119cee1178d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:05.234581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-54449030-cc5f-445b-97f7-8119cee1178d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:05.235762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-54449030-cc5f-445b-97f7-8119cee1178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:05.316333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:05.324728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 75/143] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:05.846181 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7877c88-499a-4b14-a666-c2fe0d12a65d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:05.846556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7877c88-499a-4b14-a666-c2fe0d12a65d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:05.846748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7877c88-499a-4b14-a666-c2fe0d12a65d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:05.848086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 69/144] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:05.853800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1466c17-c75c-4b7b-8ccd-2ab39b275c35 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:05.854092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1466c17-c75c-4b7b-8ccd-2ab39b275c35 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:05.854373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1466c17-c75c-4b7b-8ccd-2ab39b275c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:05.870645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7877c88-499a-4b14-a666-c2fe0d12a65d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:05.875218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:05.901935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c1466c17-c75c-4b7b-8ccd-2ab39b275c35 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:05.903120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c1466c17-c75c-4b7b-8ccd-2ab39b275c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:06.056285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 76/145] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:06.076200 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7877c88-499a-4b14-a666-c2fe0d12a65d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:06.117501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fd7b2-fa53-471e-9e21-904389e99370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:06.118254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fd7b2-fa53-471e-9e21-904389e99370 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:06.118542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fd7b2-fa53-471e-9e21-904389e99370 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:06.118820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fd7b2-fa53-471e-9e21-904389e99370 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:06.132345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fd7b2-fa53-471e-9e21-904389e99370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-067fd7b2-fa53-471e-9e21-904389e99370 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:06.137826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:06.138929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:06.139841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 70/146] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:06.145344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1466c17-c75c-4b7b-8ccd-2ab39b275c35 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:06.265276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1466c17-c75c-4b7b-8ccd-2ab39b275c35 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:06.301997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:06.303354 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105ed90-b081-42b6-8367-bcc349b41908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:06.303992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105ed90-b081-42b6-8367-bcc349b41908 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:06.304541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105ed90-b081-42b6-8367-bcc349b41908 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:06.304826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105ed90-b081-42b6-8367-bcc349b41908 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:06.305722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105ed90-b081-42b6-8367-bcc349b41908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:06.306094 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105ed90-b081-42b6-8367-bcc349b41908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:06.307537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105ed90-b081-42b6-8367-bcc349b41908 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:06.317306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 77/147] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:06.322944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fd7b2-fa53-471e-9e21-904389e99370 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:06.412136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:06.459785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fd7b2-fa53-471e-9e21-904389e99370 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:06.504071 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba9ab2-5838-41f6-97c6-374199ea8e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:06.505131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba9ab2-5838-41f6-97c6-374199ea8e4e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:06.505674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba9ab2-5838-41f6-97c6-374199ea8e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:06.506174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba9ab2-5838-41f6-97c6-374199ea8e4e None admin] PATH_INFO: `/v3/users/42e8360255b24c6f83e6dd2dd021babf` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:06.507728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba9ab2-5838-41f6-97c6-374199ea8e4e None admin] RBAC: Authorizing `identity:get_user(user_id=42e8360255b24c6f83e6dd2dd021babf)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:06.509455 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba9ab2-5838-41f6-97c6-374199ea8e4e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:06.511426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 71/148] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:06 2022] GET /identity/v3/users/42e8360255b24c6f83e6dd2dd021babf => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:06.518172 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105ed90-b081-42b6-8367-bcc349b41908 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:06.642179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba9ab2-5838-41f6-97c6-374199ea8e4e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:06.655069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105ed90-b081-42b6-8367-bcc349b41908 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:06.694133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85465bfe-a531-4b0e-acb8-1575eb93aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:06.694766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85465bfe-a531-4b0e-acb8-1575eb93aec3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:06.695047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85465bfe-a531-4b0e-acb8-1575eb93aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:06.695324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85465bfe-a531-4b0e-acb8-1575eb93aec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:06.769986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:06.789880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85465bfe-a531-4b0e-acb8-1575eb93aec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:06.792484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85465bfe-a531-4b0e-acb8-1575eb93aec3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:06.907332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba9ab2-5838-41f6-97c6-374199ea8e4e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:06.925714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 78/149] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:06.931140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a34a1-70e7-4c84-b36a-751956d1a762 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:06.931427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a34a1-70e7-4c84-b36a-751956d1a762 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:06.931705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a34a1-70e7-4c84-b36a-751956d1a762 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:06.933435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 79/150] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:06.934933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a34a1-70e7-4c84-b36a-751956d1a762 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:06.942728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:06.949692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca941-6e83-4430-9f77-926b2a7772fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:06.950659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca941-6e83-4430-9f77-926b2a7772fc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:06.951771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca941-6e83-4430-9f77-926b2a7772fc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:06.952281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca941-6e83-4430-9f77-926b2a7772fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:06.963780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ca941-6e83-4430-9f77-926b2a7772fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ec5ca941-6e83-4430-9f77-926b2a7772fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:06.970135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:06.971003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:06.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:06.974491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 72/151] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:06.975885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff3c18-692c-42a8-a710-193ad9f93d2e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:06.976432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff3c18-692c-42a8-a710-193ad9f93d2e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:06.976934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff3c18-692c-42a8-a710-193ad9f93d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:06.995459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-47ff3c18-692c-42a8-a710-193ad9f93d2e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:06.996993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-47ff3c18-692c-42a8-a710-193ad9f93d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:07.046838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a34a1-70e7-4c84-b36a-751956d1a762 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:07.058313 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:07.084568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68910a-dbd0-439d-85ac-ad7e12cfab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:07.085212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68910a-dbd0-439d-85ac-ad7e12cfab6b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:07.085493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68910a-dbd0-439d-85ac-ad7e12cfab6b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:07.085804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68910a-dbd0-439d-85ac-ad7e12cfab6b None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:07.086925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68910a-dbd0-439d-85ac-ad7e12cfab6b None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:07.088369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68910a-dbd0-439d-85ac-ad7e12cfab6b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:07.090602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 80/152] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:06 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:07.091293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68910a-dbd0-439d-85ac-ad7e12cfab6b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:07.107277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 73/153] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:07.108528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff3c18-692c-42a8-a710-193ad9f93d2e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:07.225732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68910a-dbd0-439d-85ac-ad7e12cfab6b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:07.261651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff3c18-692c-42a8-a710-193ad9f93d2e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:07.280450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57d6cf-b154-46a9-9180-da888f444c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:07.280976 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d6cf-b154-46a9-9180-da888f444c39 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:07.281132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d6cf-b154-46a9-9180-da888f444c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:07.281669 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57d6cf-b154-46a9-9180-da888f444c39 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:07.282515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57d6cf-b154-46a9-9180-da888f444c39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:07.282991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57d6cf-b154-46a9-9180-da888f444c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:07.284629 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57d6cf-b154-46a9-9180-da888f444c39 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:07.294214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 81/154] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:07.295833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744386f-74e8-438a-ab75-82d2e500d618 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:07.296307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744386f-74e8-438a-ab75-82d2e500d618 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:07.296763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744386f-74e8-438a-ab75-82d2e500d618 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:07.298347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 82/155] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:07.300095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:07.304887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39390239-c8de-4bdb-a17e-195a60d7212a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:07.304887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39390239-c8de-4bdb-a17e-195a60d7212a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:07.304887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39390239-c8de-4bdb-a17e-195a60d7212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:07.331606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e8644-4316-4fd6-9996-f39180ab7ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:07.332897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e8644-4316-4fd6-9996-f39180ab7ffb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:07.333375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e8644-4316-4fd6-9996-f39180ab7ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:07.333897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e8644-4316-4fd6-9996-f39180ab7ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:07.334821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e8644-4316-4fd6-9996-f39180ab7ffb None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb, user.id=42e8360255b24c6f83e6dd2dd021babf) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:07.336542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e8644-4316-4fd6-9996-f39180ab7ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:07.337039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e8644-4316-4fd6-9996-f39180ab7ffb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:07.343239 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-39390239-c8de-4bdb-a17e-195a60d7212a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:07.344740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-39390239-c8de-4bdb-a17e-195a60d7212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:07.344835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 74/156] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:07 2022] GET /identity/v3/role_assignments?user.id=42e8360255b24c6f83e6dd2dd021babf&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:07.349836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e8644-4316-4fd6-9996-f39180ab7ffb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:07.358081 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:07.465607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 83/157] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:07.467594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaf656-84c7-48cb-bf9f-36a92703f9db None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:07.467930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaf656-84c7-48cb-bf9f-36a92703f9db None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:07.468257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaf656-84c7-48cb-bf9f-36a92703f9db None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:07.469779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 84/158] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:07.475088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd986fd-fd63-4dcc-a172-c7807acf8096 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:07.475328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd986fd-fd63-4dcc-a172-c7807acf8096 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:07.475578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd986fd-fd63-4dcc-a172-c7807acf8096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:07.506905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7bd986fd-fd63-4dcc-a172-c7807acf8096 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:07.508033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7bd986fd-fd63-4dcc-a172-c7807acf8096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:07.518066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e8644-4316-4fd6-9996-f39180ab7ffb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:07.578474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa38f9-ae3e-42eb-9a71-d05a2d842144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:07.579485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa38f9-ae3e-42eb-9a71-d05a2d842144 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:07.579945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa38f9-ae3e-42eb-9a71-d05a2d842144 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:07.580397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa38f9-ae3e-42eb-9a71-d05a2d842144 None admin] PATH_INFO: `/v3/users/9b28b915296c4aa4a1eca58ed515da05` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:07.581939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa38f9-ae3e-42eb-9a71-d05a2d842144 None admin] RBAC: Authorizing `identity:get_user(user_id=9b28b915296c4aa4a1eca58ed515da05)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:07.583636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa38f9-ae3e-42eb-9a71-d05a2d842144 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:07.585570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 75/159] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:07 2022] GET /identity/v3/users/9b28b915296c4aa4a1eca58ed515da05 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:07.591398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa38f9-ae3e-42eb-9a71-d05a2d842144 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:07.621285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 85/160] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:07.692807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:07.742658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa38f9-ae3e-42eb-9a71-d05a2d842144 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:07.779948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d2ed0-00d1-4996-a472-2875cba456ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:07.781039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d2ed0-00d1-4996-a472-2875cba456ba None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:07.781535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d2ed0-00d1-4996-a472-2875cba456ba None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:07.782040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d2ed0-00d1-4996-a472-2875cba456ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:07.826530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd986fd-fd63-4dcc-a172-c7807acf8096 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:07.854672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d2ed0-00d1-4996-a472-2875cba456ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:07.856471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d2ed0-00d1-4996-a472-2875cba456ba None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:07.913877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:07.966315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 76/161] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:07.967031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:07.974784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d2ed0-00d1-4996-a472-2875cba456ba None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:08.030960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd986fd-fd63-4dcc-a172-c7807acf8096 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:08.082472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b84ec0-6530-4f43-a65b-518c7767a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:08.083122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b84ec0-6530-4f43-a65b-518c7767a56b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:08.083407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b84ec0-6530-4f43-a65b-518c7767a56b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:08.083684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b84ec0-6530-4f43-a65b-518c7767a56b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:08.098892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b84ec0-6530-4f43-a65b-518c7767a56b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-84b84ec0-6530-4f43-a65b-518c7767a56b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:08.104279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:08.105121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:08.106337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 86/162] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:08.113014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b84ec0-6530-4f43-a65b-518c7767a56b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:08.166054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d2ed0-00d1-4996-a472-2875cba456ba None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:08.210800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ff736-3f2c-4a24-a582-51e1687d298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:08.211895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff736-3f2c-4a24-a582-51e1687d298b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:08.212399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff736-3f2c-4a24-a582-51e1687d298b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:08.212768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff736-3f2c-4a24-a582-51e1687d298b None admin] PATH_INFO: `/v3/projects/6167aa45b8ed4061b12dfc0a65aedf57` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:08.214106 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ff736-3f2c-4a24-a582-51e1687d298b None admin] RBAC: Authorizing `identity:get_project(project_id=6167aa45b8ed4061b12dfc0a65aedf57)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:08.215892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ff736-3f2c-4a24-a582-51e1687d298b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:08.217796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 77/163] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:07 2022] GET /identity/v3/projects/6167aa45b8ed4061b12dfc0a65aedf57 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:08.218883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ff736-3f2c-4a24-a582-51e1687d298b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:08.238399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b84ec0-6530-4f43-a65b-518c7767a56b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:08.257969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:08.293229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7eb53-909e-4fd1-9d4f-ca781af6bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:08.293872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7eb53-909e-4fd1-9d4f-ca781af6bcee None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:08.294118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7eb53-909e-4fd1-9d4f-ca781af6bcee None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:08.295055 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7eb53-909e-4fd1-9d4f-ca781af6bcee None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:08.295752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7eb53-909e-4fd1-9d4f-ca781af6bcee None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:08.296024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7eb53-909e-4fd1-9d4f-ca781af6bcee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:08.297420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7eb53-909e-4fd1-9d4f-ca781af6bcee None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:08.305667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:08.310092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 87/164] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:08.311682 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7eb53-909e-4fd1-9d4f-ca781af6bcee None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:08.425785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ff736-3f2c-4a24-a582-51e1687d298b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:08.476753 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7eb53-909e-4fd1-9d4f-ca781af6bcee None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:08.499297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc3e95-38ce-431c-9492-3f2390e747a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:08.499964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc3e95-38ce-431c-9492-3f2390e747a9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:08.500251 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc3e95-38ce-431c-9492-3f2390e747a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:08.500527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc3e95-38ce-431c-9492-3f2390e747a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:08.521645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196056-51d8-4c5d-b002-53552b4a325b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:08.522275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196056-51d8-4c5d-b002-53552b4a325b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:08.522553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196056-51d8-4c5d-b002-53552b4a325b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:08.522824 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196056-51d8-4c5d-b002-53552b4a325b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:08.523550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac196056-51d8-4c5d-b002-53552b4a325b None admin] RBAC: Adding query filter params (role.id=b320236412e649d9ab1e6787ef8a6870, scope.project.id=6167aa45b8ed4061b12dfc0a65aedf57, user.id=9b28b915296c4aa4a1eca58ed515da05) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:08.523857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac196056-51d8-4c5d-b002-53552b4a325b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:08.525309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac196056-51d8-4c5d-b002-53552b4a325b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:08.527553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc3e95-38ce-431c-9492-3f2390e747a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f9cc3e95-38ce-431c-9492-3f2390e747a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:08.535182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:08.536034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 78/165] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:08.537678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc3e95-38ce-431c-9492-3f2390e747a9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:08.544044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 88/166] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:08 2022] GET /identity/v3/role_assignments?user.id=9b28b915296c4aa4a1eca58ed515da05&scope.project.id=6167aa45b8ed4061b12dfc0a65aedf57&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:08.545353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196056-51d8-4c5d-b002-53552b4a325b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:08.680692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:08.685104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:08.727553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc3e95-38ce-431c-9492-3f2390e747a9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:08.771231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f57b60-7f31-4c7a-90f5-5ca9f4644276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:08.771882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f57b60-7f31-4c7a-90f5-5ca9f4644276 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:08.772167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f57b60-7f31-4c7a-90f5-5ca9f4644276 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:08.772446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f57b60-7f31-4c7a-90f5-5ca9f4644276 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:08.785239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f57b60-7f31-4c7a-90f5-5ca9f4644276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a5f57b60-7f31-4c7a-90f5-5ca9f4644276 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:08.791300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:08.792250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:08.793014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:08.793719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196056-51d8-4c5d-b002-53552b4a325b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:08.793792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 79/167] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:08.793792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f57b60-7f31-4c7a-90f5-5ca9f4644276 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:08.865522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208542-be2f-4696-92be-6b23fe434827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:08.866210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208542-be2f-4696-92be-6b23fe434827 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:08.866493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208542-be2f-4696-92be-6b23fe434827 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:08.866770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208542-be2f-4696-92be-6b23fe434827 None admin] PATH_INFO: `/v3/users/9b28b915296c4aa4a1eca58ed515da05` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:08.868357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31208542-be2f-4696-92be-6b23fe434827 None admin] RBAC: Authorizing `identity:get_user(user_id=9b28b915296c4aa4a1eca58ed515da05)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:08.870150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31208542-be2f-4696-92be-6b23fe434827 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:08.871943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 89/168] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:08 2022] GET /identity/v3/users/9b28b915296c4aa4a1eca58ed515da05 => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:08.872528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208542-be2f-4696-92be-6b23fe434827 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:08.944459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f57b60-7f31-4c7a-90f5-5ca9f4644276 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:08.982670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63755f11-a9d6-45ed-ba17-2ed0c3c88388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:08.983758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63755f11-a9d6-45ed-ba17-2ed0c3c88388 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:08.984229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63755f11-a9d6-45ed-ba17-2ed0c3c88388 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:08.984711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63755f11-a9d6-45ed-ba17-2ed0c3c88388 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:08.985564 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63755f11-a9d6-45ed-ba17-2ed0c3c88388 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:08.986086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63755f11-a9d6-45ed-ba17-2ed0c3c88388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:08.987674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63755f11-a9d6-45ed-ba17-2ed0c3c88388 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:08.998378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 80/169] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:08.999301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208542-be2f-4696-92be-6b23fe434827 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:09.000361 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f5c4e-9171-49b0-9fc3-53943b66d437 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.000847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f5c4e-9171-49b0-9fc3-53943b66d437 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.001392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f5c4e-9171-49b0-9fc3-53943b66d437 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.002913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 81/170] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:09.003860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f5c4e-9171-49b0-9fc3-53943b66d437 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:09.007771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:09.036828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:09.044319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3815f1-9e3c-4d0d-b4c8-f85978885889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:09.045662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3815f1-9e3c-4d0d-b4c8-f85978885889 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.046098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3815f1-9e3c-4d0d-b4c8-f85978885889 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.046832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3815f1-9e3c-4d0d-b4c8-f85978885889 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.047730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3815f1-9e3c-4d0d-b4c8-f85978885889 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:09.048155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3815f1-9e3c-4d0d-b4c8-f85978885889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:09.050370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3815f1-9e3c-4d0d-b4c8-f85978885889 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:09.062223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 90/171] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:09.062223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3815f1-9e3c-4d0d-b4c8-f85978885889 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:09.129415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f5c4e-9171-49b0-9fc3-53943b66d437 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:09.177393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97c5a2-ea49-48bb-ae1f-3ec96b7482dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:09.178439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97c5a2-ea49-48bb-ae1f-3ec96b7482dd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.178809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97c5a2-ea49-48bb-ae1f-3ec96b7482dd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.179177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97c5a2-ea49-48bb-ae1f-3ec96b7482dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.183820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3815f1-9e3c-4d0d-b4c8-f85978885889 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:09.226782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c7f12-3bee-44c2-aee8-7a17eb2edf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:09.227800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c7f12-3bee-44c2-aee8-7a17eb2edf25 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.228273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c7f12-3bee-44c2-aee8-7a17eb2edf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.228810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c7f12-3bee-44c2-aee8-7a17eb2edf25 None admin] PATH_INFO: `/v3/users/9b28b915296c4aa4a1eca58ed515da05` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.230213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c7f12-3bee-44c2-aee8-7a17eb2edf25 None admin] RBAC: Authorizing `identity:get_user(user_id=9b28b915296c4aa4a1eca58ed515da05)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:09.231834 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c7f12-3bee-44c2-aee8-7a17eb2edf25 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:09.234410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 91/172] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:09 2022] GET /identity/v3/users/9b28b915296c4aa4a1eca58ed515da05 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:09.235946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cc797-34d7-43fc-bce7-b7c633e18555 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.236444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cc797-34d7-43fc-bce7-b7c633e18555 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.236906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cc797-34d7-43fc-bce7-b7c633e18555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.263208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-358cc797-34d7-43fc-bce7-b7c633e18555 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:09.265377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-358cc797-34d7-43fc-bce7-b7c633e18555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:09.267180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97c5a2-ea49-48bb-ae1f-3ec96b7482dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:09.269808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97c5a2-ea49-48bb-ae1f-3ec96b7482dd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:09.272604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:09.334168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:09.350460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 92/173] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:09.351789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cc797-34d7-43fc-bce7-b7c633e18555 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:09.447450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 82/174] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:09.449688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97c5a2-ea49-48bb-ae1f-3ec96b7482dd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:09.504347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cc797-34d7-43fc-bce7-b7c633e18555 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:09.553389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c361300-ae28-4aa8-aabf-6aa7b2916347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:09.554532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361300-ae28-4aa8-aabf-6aa7b2916347 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.555009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361300-ae28-4aa8-aabf-6aa7b2916347 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.555448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361300-ae28-4aa8-aabf-6aa7b2916347 None admin] PATH_INFO: `/v3/users/dd3511d7acd648a2b9ebd696a1ef34bc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.556992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c361300-ae28-4aa8-aabf-6aa7b2916347 None admin] RBAC: Authorizing `identity:get_user(user_id=dd3511d7acd648a2b9ebd696a1ef34bc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:09.559386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c361300-ae28-4aa8-aabf-6aa7b2916347 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:09.562045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 93/175] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:09 2022] GET /identity/v3/users/dd3511d7acd648a2b9ebd696a1ef34bc => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:09.563092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c361300-ae28-4aa8-aabf-6aa7b2916347 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:09.586402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97c5a2-ea49-48bb-ae1f-3ec96b7482dd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:09.589306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:09.633763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77242-ddfb-4ee6-9f35-b8144c6f14f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:09.634713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77242-ddfb-4ee6-9f35-b8144c6f14f0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.635058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77242-ddfb-4ee6-9f35-b8144c6f14f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.635406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77242-ddfb-4ee6-9f35-b8144c6f14f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.636469 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:09.686884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c361300-ae28-4aa8-aabf-6aa7b2916347 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:09.720932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db065a4-9c20-4d41-a577-95e1125ddac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:09.721124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77242-ddfb-4ee6-9f35-b8144c6f14f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:09.721484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db065a4-9c20-4d41-a577-95e1125ddac3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.721794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db065a4-9c20-4d41-a577-95e1125ddac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.722070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db065a4-9c20-4d41-a577-95e1125ddac3 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.722436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77242-ddfb-4ee6-9f35-b8144c6f14f0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:09.723192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db065a4-9c20-4d41-a577-95e1125ddac3 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:09.724869 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db065a4-9c20-4d41-a577-95e1125ddac3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:09.726681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 94/176] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:09 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:09.727615 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c241-6a4c-436a-b3c0-3bd9ae98130c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.727899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c241-6a4c-436a-b3c0-3bd9ae98130c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.728170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c241-6a4c-436a-b3c0-3bd9ae98130c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.729474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 95/177] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:09.734443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c241-6a4c-436a-b3c0-3bd9ae98130c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:09.827599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 83/178] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:09.828539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77242-ddfb-4ee6-9f35-b8144c6f14f0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:09.834714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:09.855445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c241-6a4c-436a-b3c0-3bd9ae98130c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:09.885657 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:09.895788 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c589ca-c8cc-48ac-b22c-8962ebf833dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:09.896629 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c589ca-c8cc-48ac-b22c-8962ebf833dc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.897162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c589ca-c8cc-48ac-b22c-8962ebf833dc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.897441 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c589ca-c8cc-48ac-b22c-8962ebf833dc None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.898913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c589ca-c8cc-48ac-b22c-8962ebf833dc None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:09.900366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c589ca-c8cc-48ac-b22c-8962ebf833dc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:09.907150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 96/179] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:09 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:09.907150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c589ca-c8cc-48ac-b22c-8962ebf833dc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:09.948024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77242-ddfb-4ee6-9f35-b8144c6f14f0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:09.982009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa7735-53d7-4628-9edb-1f34f4b5d0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:09.983194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7735-53d7-4628-9edb-1f34f4b5d0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.983482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7735-53d7-4628-9edb-1f34f4b5d0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.983759 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7735-53d7-4628-9edb-1f34f4b5d0e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.993363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa7735-53d7-4628-9edb-1f34f4b5d0e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d0aa7735-53d7-4628-9edb-1f34f4b5d0e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:09.998313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:09.999153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:09.999940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 84/180] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:58:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:10.000598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d22f-723b-4807-b72e-c57744a446fe None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.001223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d22f-723b-4807-b72e-c57744a446fe None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.001223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d22f-723b-4807-b72e-c57744a446fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.006205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c589ca-c8cc-48ac-b22c-8962ebf833dc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.018497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d724d22f-723b-4807-b72e-c57744a446fe None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:10.019681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d724d22f-723b-4807-b72e-c57744a446fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:10.041529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86cd6f-47ea-4920-8cfd-a162b53e2b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.042163 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86cd6f-47ea-4920-8cfd-a162b53e2b25 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.042445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86cd6f-47ea-4920-8cfd-a162b53e2b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.042714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86cd6f-47ea-4920-8cfd-a162b53e2b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.043434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86cd6f-47ea-4920-8cfd-a162b53e2b25 None admin] RBAC: Adding query filter params (role.id=b320236412e649d9ab1e6787ef8a6870, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb, user.id=9b28b915296c4aa4a1eca58ed515da05) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:10.043741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86cd6f-47ea-4920-8cfd-a162b53e2b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.046009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86cd6f-47ea-4920-8cfd-a162b53e2b25 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.061651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 97/181] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:09 2022] GET /identity/v3/role_assignments?user.id=9b28b915296c4aa4a1eca58ed515da05&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:10.061651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86cd6f-47ea-4920-8cfd-a162b53e2b25 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.080736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:10.090682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 85/182] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:10.092692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d22f-723b-4807-b72e-c57744a446fe None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.140093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:10.203067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86cd6f-47ea-4920-8cfd-a162b53e2b25 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.228853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d22f-723b-4807-b72e-c57744a446fe None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.259308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4b7c2-3aa1-448d-a963-d12a2edcc66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.260052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b7c2-3aa1-448d-a963-d12a2edcc66e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.260300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b7c2-3aa1-448d-a963-d12a2edcc66e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.260580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b7c2-3aa1-448d-a963-d12a2edcc66e None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.262429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4b7c2-3aa1-448d-a963-d12a2edcc66e None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.264486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4b7c2-3aa1-448d-a963-d12a2edcc66e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.267597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 98/183] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:10.268745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab1d9-6b92-48bd-8e5a-32b78371f87a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.269029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab1d9-6b92-48bd-8e5a-32b78371f87a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.269303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab1d9-6b92-48bd-8e5a-32b78371f87a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.275114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 99/184] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:10.275696 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ab1d9-6b92-48bd-8e5a-32b78371f87a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.281568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10254e-2e69-4686-892d-6e92705ce6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.282552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10254e-2e69-4686-892d-6e92705ce6dc None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.283026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10254e-2e69-4686-892d-6e92705ce6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.283488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10254e-2e69-4686-892d-6e92705ce6dc None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/users/dd3511d7acd648a2b9ebd696a1ef34bc/roles/882e144ddabb436ba7e9c2130cf9cb49` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.285733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10254e-2e69-4686-892d-6e92705ce6dc None admin] RBAC: Authorizing `identity:create_grant(project_id=4b294bc0bf21460b92e0270a4e59e9eb, user_id=dd3511d7acd648a2b9ebd696a1ef34bc, role_id=882e144ddabb436ba7e9c2130cf9cb49)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.287194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10254e-2e69-4686-892d-6e92705ce6dc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.302698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 86/185] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:58:10 2022] PUT /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/users/dd3511d7acd648a2b9ebd696a1ef34bc/roles/882e144ddabb436ba7e9c2130cf9cb49 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:10.303034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10254e-2e69-4686-892d-6e92705ce6dc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.399948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:10.424685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ab1d9-6b92-48bd-8e5a-32b78371f87a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.453121 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10254e-2e69-4686-892d-6e92705ce6dc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.453693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:10.463868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c9a2c-93ce-49c1-adda-2a9e565495dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.464528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9a2c-93ce-49c1-adda-2a9e565495dd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.464774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9a2c-93ce-49c1-adda-2a9e565495dd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.465050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9a2c-93ce-49c1-adda-2a9e565495dd None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.465920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c9a2c-93ce-49c1-adda-2a9e565495dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:10.466106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c9a2c-93ce-49c1-adda-2a9e565495dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.467682 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c9a2c-93ce-49c1-adda-2a9e565495dd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.478149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 100/186] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:10.479196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcfcdd-3b22-496d-ad37-360f528e1de4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.479481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcfcdd-3b22-496d-ad37-360f528e1de4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.479752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcfcdd-3b22-496d-ad37-360f528e1de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.501786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47107-bc9c-4837-8510-4f897373712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.502405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47107-bc9c-4837-8510-4f897373712e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.502685 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47107-bc9c-4837-8510-4f897373712e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.502850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-51bcfcdd-3b22-496d-ad37-360f528e1de4 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:10.502945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47107-bc9c-4837-8510-4f897373712e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.503713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee47107-bc9c-4837-8510-4f897373712e None admin] RBAC: Adding query filter params (role.id=c59031d5db354a478ab7a9ac0000e098, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb, user.id=9b28b915296c4aa4a1eca58ed515da05) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:10.503996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee47107-bc9c-4837-8510-4f897373712e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.504088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-51bcfcdd-3b22-496d-ad37-360f528e1de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:10.505446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee47107-bc9c-4837-8510-4f897373712e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.513313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 87/187] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/role_assignments?user.id=9b28b915296c4aa4a1eca58ed515da05&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=c59031d5db354a478ab7a9ac0000e098 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:10.514602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47107-bc9c-4837-8510-4f897373712e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.591028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 101/188] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:10.592199 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcfcdd-3b22-496d-ad37-360f528e1de4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.650672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47107-bc9c-4837-8510-4f897373712e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.673746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:10.708595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42571ed-9053-4e1f-84e5-60dba5cef39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.709313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42571ed-9053-4e1f-84e5-60dba5cef39a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.709590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42571ed-9053-4e1f-84e5-60dba5cef39a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.709883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42571ed-9053-4e1f-84e5-60dba5cef39a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.722457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcfcdd-3b22-496d-ad37-360f528e1de4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.736728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42571ed-9053-4e1f-84e5-60dba5cef39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d42571ed-9053-4e1f-84e5-60dba5cef39a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:10.742151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:10.743019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:10.743814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 88/189] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:10.750045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42571ed-9053-4e1f-84e5-60dba5cef39a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.753981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:10.765283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2caebe-37b2-422b-9261-deaa3366ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.766256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2caebe-37b2-422b-9261-deaa3366ab78 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.766742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2caebe-37b2-422b-9261-deaa3366ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.767239 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2caebe-37b2-422b-9261-deaa3366ab78 None admin] PATH_INFO: `/v3/users/3043616cabe84e879950bca9f05bb1de` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.783356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2caebe-37b2-422b-9261-deaa3366ab78 None admin] RBAC: Authorizing `identity:get_user(user_id=3043616cabe84e879950bca9f05bb1de)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.785213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2caebe-37b2-422b-9261-deaa3366ab78 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.787456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 102/190] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/users/3043616cabe84e879950bca9f05bb1de => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:10.793159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2caebe-37b2-422b-9261-deaa3366ab78 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.866823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42571ed-9053-4e1f-84e5-60dba5cef39a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.913339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2caebe-37b2-422b-9261-deaa3366ab78 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.918049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcd646-7055-454c-a57e-7ae73e3f8a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.918949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd646-7055-454c-a57e-7ae73e3f8a49 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.919298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd646-7055-454c-a57e-7ae73e3f8a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.919979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd646-7055-454c-a57e-7ae73e3f8a49 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.920821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd646-7055-454c-a57e-7ae73e3f8a49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:10.921188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd646-7055-454c-a57e-7ae73e3f8a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.922730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd646-7055-454c-a57e-7ae73e3f8a49 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.936948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 89/191] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:10.938791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcd646-7055-454c-a57e-7ae73e3f8a49 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.954185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13697b5c-748c-4137-aaf7-eb22c27814a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.955216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13697b5c-748c-4137-aaf7-eb22c27814a8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.955645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13697b5c-748c-4137-aaf7-eb22c27814a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.956064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13697b5c-748c-4137-aaf7-eb22c27814a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.990001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:11.010920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:11.038074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13697b5c-748c-4137-aaf7-eb22c27814a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.039447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13697b5c-748c-4137-aaf7-eb22c27814a8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.049948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcd646-7055-454c-a57e-7ae73e3f8a49 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.084243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1a032-4a87-47a7-b297-af19595faf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.085173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1a032-4a87-47a7-b297-af19595faf38 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.085456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1a032-4a87-47a7-b297-af19595faf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.085767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1a032-4a87-47a7-b297-af19595faf38 None admin] PATH_INFO: `/v3/users/3043616cabe84e879950bca9f05bb1de` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.086947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1a032-4a87-47a7-b297-af19595faf38 None admin] RBAC: Authorizing `identity:get_user(user_id=3043616cabe84e879950bca9f05bb1de)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.088381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1a032-4a87-47a7-b297-af19595faf38 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.090169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 90/192] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/users/3043616cabe84e879950bca9f05bb1de => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:11.090931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1a032-4a87-47a7-b297-af19595faf38 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.162276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 103/193] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:11.165613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13697b5c-748c-4137-aaf7-eb22c27814a8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.209024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1a032-4a87-47a7-b297-af19595faf38 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.218470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:11.244828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7758c-f69c-49fe-b19c-5688094e15b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.245457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7758c-f69c-49fe-b19c-5688094e15b9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.245763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7758c-f69c-49fe-b19c-5688094e15b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.246034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7758c-f69c-49fe-b19c-5688094e15b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.247121 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7758c-f69c-49fe-b19c-5688094e15b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.249342 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7758c-f69c-49fe-b19c-5688094e15b9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.251341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 91/194] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:11.252175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7758c-f69c-49fe-b19c-5688094e15b9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.271586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:11.306182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13697b5c-748c-4137-aaf7-eb22c27814a8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.354691 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fc5a8-46d4-45df-84fd-dbf99cc93074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.355308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fc5a8-46d4-45df-84fd-dbf99cc93074 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.355692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fc5a8-46d4-45df-84fd-dbf99cc93074 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.355969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fc5a8-46d4-45df-84fd-dbf99cc93074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.370724 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7758c-f69c-49fe-b19c-5688094e15b9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.408869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af402302-428a-4e8b-bf2f-c134b00fb860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.409954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af402302-428a-4e8b-bf2f-c134b00fb860 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.410240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af402302-428a-4e8b-bf2f-c134b00fb860 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.410513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af402302-428a-4e8b-bf2f-c134b00fb860 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.411622 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af402302-428a-4e8b-bf2f-c134b00fb860 None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.413440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af402302-428a-4e8b-bf2f-c134b00fb860 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.415743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 92/195] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:11 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:11.416714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af402302-428a-4e8b-bf2f-c134b00fb860 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.449346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fc5a8-46d4-45df-84fd-dbf99cc93074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.451079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fc5a8-46d4-45df-84fd-dbf99cc93074 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.463876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:11.533871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af402302-428a-4e8b-bf2f-c134b00fb860 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.544343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:11.571110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fb5b6-534e-415f-955d-53934af780c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.571639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb5b6-534e-415f-955d-53934af780c5 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.571909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb5b6-534e-415f-955d-53934af780c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.572175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb5b6-534e-415f-955d-53934af780c5 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.572817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fb5b6-534e-415f-955d-53934af780c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.574754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fb5b6-534e-415f-955d-53934af780c5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.578427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 104/196] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:11.579485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fc5a8-46d4-45df-84fd-dbf99cc93074 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.613242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 93/197] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:58:11 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:11.614230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fb5b6-534e-415f-955d-53934af780c5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.717034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fc5a8-46d4-45df-84fd-dbf99cc93074 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.757262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febb12-01cb-48f3-8bec-ee8f2679ef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.758325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febb12-01cb-48f3-8bec-ee8f2679ef2a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.758890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febb12-01cb-48f3-8bec-ee8f2679ef2a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.759361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febb12-01cb-48f3-8bec-ee8f2679ef2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.760298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81febb12-01cb-48f3-8bec-ee8f2679ef2a None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29, user.id=3043616cabe84e879950bca9f05bb1de) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:11.760813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81febb12-01cb-48f3-8bec-ee8f2679ef2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.762561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81febb12-01cb-48f3-8bec-ee8f2679ef2a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.768287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:11.770803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 105/198] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:11 2022] GET /identity/v3/role_assignments?user.id=3043616cabe84e879950bca9f05bb1de&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:11.771890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fb5b6-534e-415f-955d-53934af780c5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.822396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed2849-448f-437c-8da6-0a779d9bd1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.822974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed2849-448f-437c-8da6-0a779d9bd1df None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.823253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed2849-448f-437c-8da6-0a779d9bd1df None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.823525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed2849-448f-437c-8da6-0a779d9bd1df None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.824795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed2849-448f-437c-8da6-0a779d9bd1df None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.826900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed2849-448f-437c-8da6-0a779d9bd1df None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.829078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 94/199] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:11 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:11.835859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febb12-01cb-48f3-8bec-ee8f2679ef2a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.885257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:11.951021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febb12-01cb-48f3-8bec-ee8f2679ef2a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.986510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9c332-9b64-4b51-80e0-74fb1e35c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.987122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9c332-9b64-4b51-80e0-74fb1e35c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.987439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9c332-9b64-4b51-80e0-74fb1e35c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.987755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9c332-9b64-4b51-80e0-74fb1e35c9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.988474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9c332-9b64-4b51-80e0-74fb1e35c9b7 None admin] RBAC: Adding query filter params (role.id=c59031d5db354a478ab7a9ac0000e098, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29, user.id=3043616cabe84e879950bca9f05bb1de) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:11.988829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9c332-9b64-4b51-80e0-74fb1e35c9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.990348 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9c332-9b64-4b51-80e0-74fb1e35c9b7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.996139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 106/200] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:11 2022] GET /identity/v3/role_assignments?user.id=3043616cabe84e879950bca9f05bb1de&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=c59031d5db354a478ab7a9ac0000e098 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:12.706542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbe42d-7667-4360-b4e6-d9319878e2bf None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:12.707037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbe42d-7667-4360-b4e6-d9319878e2bf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:12.707108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbe42d-7667-4360-b4e6-d9319878e2bf None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:12.708435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 95/201] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:12.713716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8724d2-4b22-461b-b285-e906079619a0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:12.714121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8724d2-4b22-461b-b285-e906079619a0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:12.714286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8724d2-4b22-461b-b285-e906079619a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:12.739387 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ad8724d2-4b22-461b-b285-e906079619a0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:12.740567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ad8724d2-4b22-461b-b285-e906079619a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:12.824899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 107/202] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:13.288897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbe42d-7667-4360-b4e6-d9319878e2bf None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:13.413005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbe42d-7667-4360-b4e6-d9319878e2bf None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:13.455486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e55dcb-e248-45da-8839-fc1cee0d2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:13.456122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e55dcb-e248-45da-8839-fc1cee0d2b69 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:13.456403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e55dcb-e248-45da-8839-fc1cee0d2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:13.456665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e55dcb-e248-45da-8839-fc1cee0d2b69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:13.474470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e55dcb-e248-45da-8839-fc1cee0d2b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-36e55dcb-e248-45da-8839-fc1cee0d2b69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:13.479376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:13.480231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:13.481028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 96/203] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:13.490330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8724d2-4b22-461b-b285-e906079619a0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:13.562347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:13.685406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8724d2-4b22-461b-b285-e906079619a0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:13.752715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4711f16-c38b-4add-ab4d-b550fde497a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:13.753334 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711f16-c38b-4add-ab4d-b550fde497a8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:13.753594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711f16-c38b-4add-ab4d-b550fde497a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:13.753886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711f16-c38b-4add-ab4d-b550fde497a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:13.754559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4711f16-c38b-4add-ab4d-b550fde497a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:13.754858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4711f16-c38b-4add-ab4d-b550fde497a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:13.756224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4711f16-c38b-4add-ab4d-b550fde497a8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:13.772666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 108/204] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:13.778285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e55dcb-e248-45da-8839-fc1cee0d2b69 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:13.839147 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:13.948450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e55dcb-e248-45da-8839-fc1cee0d2b69 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:13.995253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896cdef-7b2f-4f15-b301-b4168a343f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:13.995886 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896cdef-7b2f-4f15-b301-b4168a343f4d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:13.996161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896cdef-7b2f-4f15-b301-b4168a343f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:13.996432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896cdef-7b2f-4f15-b301-b4168a343f4d None admin] PATH_INFO: `/v3/users/dd3511d7acd648a2b9ebd696a1ef34bc` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:13.998143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896cdef-7b2f-4f15-b301-b4168a343f4d None admin] RBAC: Authorizing `identity:get_user(user_id=dd3511d7acd648a2b9ebd696a1ef34bc)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:13.999753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896cdef-7b2f-4f15-b301-b4168a343f4d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:14.001520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 97/205] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:13 2022] GET /identity/v3/users/dd3511d7acd648a2b9ebd696a1ef34bc => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:14.006930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4711f16-c38b-4add-ab4d-b550fde497a8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:14.196406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4711f16-c38b-4add-ab4d-b550fde497a8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:14.213344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:14.265654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63c18-9674-402e-a237-647666fdf0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:14.266659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63c18-9674-402e-a237-647666fdf0ff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.267158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63c18-9674-402e-a237-647666fdf0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.267625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63c18-9674-402e-a237-647666fdf0ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.370734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138acfc3-9e7e-4c98-b26f-9b5ddef019c0 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.371063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138acfc3-9e7e-4c98-b26f-9b5ddef019c0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.371269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138acfc3-9e7e-4c98-b26f-9b5ddef019c0 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.373303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 98/206] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:14.380059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc63c18-9674-402e-a237-647666fdf0ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:14.381566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc63c18-9674-402e-a237-647666fdf0ff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:14.386276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58d3f4-c5ac-4380-be85-16f2dbf31e88 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.386610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58d3f4-c5ac-4380-be85-16f2dbf31e88 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.386824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58d3f4-c5ac-4380-be85-16f2dbf31e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.414705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ce58d3f4-c5ac-4380-be85-16f2dbf31e88 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:14.417474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ce58d3f4-c5ac-4380-be85-16f2dbf31e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:14.536472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 99/207] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:14.537912 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666b36-8f90-49b8-aa29-49d1c78d5e53 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.538196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666b36-8f90-49b8-aa29-49d1c78d5e53 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.538468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666b36-8f90-49b8-aa29-49d1c78d5e53 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.539840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 100/208] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:14.555230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479adba-d638-477f-bb86-f08cd3501282 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.555230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479adba-d638-477f-bb86-f08cd3501282 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.555646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479adba-d638-477f-bb86-f08cd3501282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.563932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:14.571385 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 109/209] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:14.581331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63c18-9674-402e-a237-647666fdf0ff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:14.594525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8479adba-d638-477f-bb86-f08cd3501282 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:14.597539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8479adba-d638-477f-bb86-f08cd3501282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:14.632035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:14.684400 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 101/210] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:14.686694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931c0db-f652-4f65-98ac-f417ff747015 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.686982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931c0db-f652-4f65-98ac-f417ff747015 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.687251 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931c0db-f652-4f65-98ac-f417ff747015 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.688635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 102/211] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:14.689531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb80bc-c756-4079-8edc-cd7ac0c5c868 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.689932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb80bc-c756-4079-8edc-cd7ac0c5c868 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.690161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb80bc-c756-4079-8edc-cd7ac0c5c868 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.691529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 103/212] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:14.696704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65652ea3-96fd-47a4-9ebf-52972b8ab477 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.696993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65652ea3-96fd-47a4-9ebf-52972b8ab477 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.697265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65652ea3-96fd-47a4-9ebf-52972b8ab477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.715792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-65652ea3-96fd-47a4-9ebf-52972b8ab477 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:14.717027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-65652ea3-96fd-47a4-9ebf-52972b8ab477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:14.722363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63c18-9674-402e-a237-647666fdf0ff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:14.765271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f96fc-f635-4aff-9e75-66eab0f2795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:14.765937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f96fc-f635-4aff-9e75-66eab0f2795d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.766191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f96fc-f635-4aff-9e75-66eab0f2795d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.766458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f96fc-f635-4aff-9e75-66eab0f2795d None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.767580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f96fc-f635-4aff-9e75-66eab0f2795d None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:14.769034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f96fc-f635-4aff-9e75-66eab0f2795d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:14.771125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 110/213] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:14 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:14.772307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de83b6-6e28-4641-95cd-f31a51cf3973 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.772588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de83b6-6e28-4641-95cd-f31a51cf3973 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.772853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de83b6-6e28-4641-95cd-f31a51cf3973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.792540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-37de83b6-6e28-4641-95cd-f31a51cf3973 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:14.793809 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-37de83b6-6e28-4641-95cd-f31a51cf3973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:14.809436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 104/214] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:14.812092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65652ea3-96fd-47a4-9ebf-52972b8ab477 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:14.862413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:14.873640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 111/215] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:14.875013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de83b6-6e28-4641-95cd-f31a51cf3973 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:14.977964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:14.986038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de83b6-6e28-4641-95cd-f31a51cf3973 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:14.995112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65652ea3-96fd-47a4-9ebf-52972b8ab477 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.030674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30d21c-9672-4d40-bf71-a5adf9f47226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.031274 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30d21c-9672-4d40-bf71-a5adf9f47226 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.031547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30d21c-9672-4d40-bf71-a5adf9f47226 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.031816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30d21c-9672-4d40-bf71-a5adf9f47226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.032011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c5e70-2df1-464c-aa69-fa1a273111df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.032535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30d21c-9672-4d40-bf71-a5adf9f47226 None admin] RBAC: Adding query filter params (role.id=882e144ddabb436ba7e9c2130cf9cb49, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb, user.id=dd3511d7acd648a2b9ebd696a1ef34bc) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:15.032638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c5e70-2df1-464c-aa69-fa1a273111df None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.032891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30d21c-9672-4d40-bf71-a5adf9f47226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:15.032986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c5e70-2df1-464c-aa69-fa1a273111df None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.033165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c5e70-2df1-464c-aa69-fa1a273111df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.034480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30d21c-9672-4d40-bf71-a5adf9f47226 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:15.040243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 105/216] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:14 2022] GET /identity/v3/role_assignments?user.id=dd3511d7acd648a2b9ebd696a1ef34bc&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=882e144ddabb436ba7e9c2130cf9cb49 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:15.041098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30d21c-9672-4d40-bf71-a5adf9f47226 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.051474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c5e70-2df1-464c-aa69-fa1a273111df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cf3c5e70-2df1-464c-aa69-fa1a273111df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:15.058272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:15.059135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:15.060075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 112/217] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:15.070945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c5e70-2df1-464c-aa69-fa1a273111df None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.161446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:15.180539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30d21c-9672-4d40-bf71-a5adf9f47226 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.212993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c5e70-2df1-464c-aa69-fa1a273111df None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.218744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3cd9e-6b47-4b49-a0ed-a7f891de1b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.219478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3cd9e-6b47-4b49-a0ed-a7f891de1b57 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.219852 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3cd9e-6b47-4b49-a0ed-a7f891de1b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.220188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3cd9e-6b47-4b49-a0ed-a7f891de1b57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.231450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3cd9e-6b47-4b49-a0ed-a7f891de1b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e8f3cd9e-6b47-4b49-a0ed-a7f891de1b57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:15.237474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:15.239691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 106/218] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:15.241556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3cd9e-6b47-4b49-a0ed-a7f891de1b57 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.252654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:15.258738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb85e2-c0da-41fb-87ae-d551caaae555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.259832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb85e2-c0da-41fb-87ae-d551caaae555 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.259832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb85e2-c0da-41fb-87ae-d551caaae555 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.260038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb85e2-c0da-41fb-87ae-d551caaae555 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.260540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb85e2-c0da-41fb-87ae-d551caaae555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:15.260842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb85e2-c0da-41fb-87ae-d551caaae555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:15.262294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb85e2-c0da-41fb-87ae-d551caaae555 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:15.271813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 113/219] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:15.272931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb85e2-c0da-41fb-87ae-d551caaae555 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.353361 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3cd9e-6b47-4b49-a0ed-a7f891de1b57 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.380211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb85e2-c0da-41fb-87ae-d551caaae555 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.386167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b537f7a-61c4-4c08-b03b-9226cab03179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.386804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b537f7a-61c4-4c08-b03b-9226cab03179 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.387079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b537f7a-61c4-4c08-b03b-9226cab03179 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.387345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b537f7a-61c4-4c08-b03b-9226cab03179 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.388587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b537f7a-61c4-4c08-b03b-9226cab03179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:15.390091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b537f7a-61c4-4c08-b03b-9226cab03179 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:15.391657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 107/220] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:15.395743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:15.396961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b537f7a-61c4-4c08-b03b-9226cab03179 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.413861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31395-dbe1-4831-bbd9-c1d68e72cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.414491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31395-dbe1-4831-bbd9-c1d68e72cb3e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.414772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31395-dbe1-4831-bbd9-c1d68e72cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.415045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31395-dbe1-4831-bbd9-c1d68e72cb3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.426108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a31395-dbe1-4831-bbd9-c1d68e72cb3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-24a31395-dbe1-4831-bbd9-c1d68e72cb3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:15.431475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:15.432336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:15.433136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 114/221] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:15.433812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31395-dbe1-4831-bbd9-c1d68e72cb3e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.477508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:15.499430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b537f7a-61c4-4c08-b03b-9226cab03179 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.532373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c54112-718a-44fb-967a-9a3887f3f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.532975 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c54112-718a-44fb-967a-9a3887f3f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.533196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31395-dbe1-4831-bbd9-c1d68e72cb3e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.533300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c54112-718a-44fb-967a-9a3887f3f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.533510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c54112-718a-44fb-967a-9a3887f3f9f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.534192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c54112-718a-44fb-967a-9a3887f3f9f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:15.534504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c54112-718a-44fb-967a-9a3887f3f9f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:15.535888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c54112-718a-44fb-967a-9a3887f3f9f5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:15.543883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 108/222] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:15.544673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c54112-718a-44fb-967a-9a3887f3f9f5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.565981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dcbf0-1bf1-4905-9646-a40942b370cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.566611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dcbf0-1bf1-4905-9646-a40942b370cc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.566891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dcbf0-1bf1-4905-9646-a40942b370cc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.567158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dcbf0-1bf1-4905-9646-a40942b370cc None admin] PATH_INFO: `/v3/users/3043616cabe84e879950bca9f05bb1de` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.568267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dcbf0-1bf1-4905-9646-a40942b370cc None admin] RBAC: Authorizing `identity:get_user(user_id=3043616cabe84e879950bca9f05bb1de)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:15.569761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dcbf0-1bf1-4905-9646-a40942b370cc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:15.571339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 115/223] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/users/3043616cabe84e879950bca9f05bb1de => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:15.572085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dcbf0-1bf1-4905-9646-a40942b370cc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.617531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:15.646194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c54112-718a-44fb-967a-9a3887f3f9f5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.672577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dcbf0-1bf1-4905-9646-a40942b370cc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.683895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050af83-2db8-435e-aab0-a155d86de53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.684495 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050af83-2db8-435e-aab0-a155d86de53e None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.684772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050af83-2db8-435e-aab0-a155d86de53e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.685147 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050af83-2db8-435e-aab0-a155d86de53e None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.685821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050af83-2db8-435e-aab0-a155d86de53e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:15.687273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050af83-2db8-435e-aab0-a155d86de53e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:15.697894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:15.708252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa4874-1303-4de5-a4d1-bdc6547daccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.708856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa4874-1303-4de5-a4d1-bdc6547daccb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.709136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa4874-1303-4de5-a4d1-bdc6547daccb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.709402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa4874-1303-4de5-a4d1-bdc6547daccb None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.710017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 109/224] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:58:15 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:15.710134 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa4874-1303-4de5-a4d1-bdc6547daccb None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:15.710377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa4874-1303-4de5-a4d1-bdc6547daccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:15.710827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050af83-2db8-435e-aab0-a155d86de53e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.711820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa4874-1303-4de5-a4d1-bdc6547daccb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:15.721761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 116/225] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:15.722545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa4874-1303-4de5-a4d1-bdc6547daccb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.836029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050af83-2db8-435e-aab0-a155d86de53e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.837340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa4874-1303-4de5-a4d1-bdc6547daccb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:15.846424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:15.877987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8d0a-6788-4fbc-8d35-1113695a152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.878540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8d0a-6788-4fbc-8d35-1113695a152c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.878817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8d0a-6788-4fbc-8d35-1113695a152c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.879121 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8d0a-6788-4fbc-8d35-1113695a152c None admin] PATH_INFO: `/v3/users/3043616cabe84e879950bca9f05bb1de` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.880191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a8d0a-6788-4fbc-8d35-1113695a152c None admin] RBAC: Authorizing `identity:get_user(user_id=3043616cabe84e879950bca9f05bb1de)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:15.880300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd965-5220-4468-a1bf-37d6e61b427c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:15.880912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd965-5220-4468-a1bf-37d6e61b427c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:15.881190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd965-5220-4468-a1bf-37d6e61b427c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:15.881462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd965-5220-4468-a1bf-37d6e61b427c None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:15.881676 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a8d0a-6788-4fbc-8d35-1113695a152c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:15.882635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cd965-5220-4468-a1bf-37d6e61b427c None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:15.887762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 110/226] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/users/3043616cabe84e879950bca9f05bb1de => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:15.887898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cd965-5220-4468-a1bf-37d6e61b427c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:15.888016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8d0a-6788-4fbc-8d35-1113695a152c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.888640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 117/227] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:15.890781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd965-5220-4468-a1bf-37d6e61b427c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:15.960485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:16.017542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd965-5220-4468-a1bf-37d6e61b427c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:16.019778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8d0a-6788-4fbc-8d35-1113695a152c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:16.053841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7d7c8-c9fb-443e-86a2-813acf9234a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:16.054754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7d7c8-c9fb-443e-86a2-813acf9234a3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:16.055038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7d7c8-c9fb-443e-86a2-813acf9234a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:16.055309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7d7c8-c9fb-443e-86a2-813acf9234a3 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:16.056405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7d7c8-c9fb-443e-86a2-813acf9234a3 None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:16.057351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e298bf-c2af-452d-8ae1-02cc59e29ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:16.057871 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7d7c8-c9fb-443e-86a2-813acf9234a3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:16.058038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e298bf-c2af-452d-8ae1-02cc59e29ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:16.058304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e298bf-c2af-452d-8ae1-02cc59e29ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:16.058576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e298bf-c2af-452d-8ae1-02cc59e29ba8 None admin] PATH_INFO: `/v3/users/b537c3e416d24e45a7f60d553a090d54` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:16.059645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 118/228] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:16.060843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7d7c8-c9fb-443e-86a2-813acf9234a3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:16.076433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e298bf-c2af-452d-8ae1-02cc59e29ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=b537c3e416d24e45a7f60d553a090d54)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:16.077931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e298bf-c2af-452d-8ae1-02cc59e29ba8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:16.079617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 111/229] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:15 2022] GET /identity/v3/users/b537c3e416d24e45a7f60d553a090d54 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:16.081291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e298bf-c2af-452d-8ae1-02cc59e29ba8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:16.121719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:16.193039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7d7c8-c9fb-443e-86a2-813acf9234a3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:16.211908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e298bf-c2af-452d-8ae1-02cc59e29ba8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:16.233256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d20e8a-be40-4683-9838-c4585878689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:16.234116 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20e8a-be40-4683-9838-c4585878689a None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:16.234405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20e8a-be40-4683-9838-c4585878689a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:16.234686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20e8a-be40-4683-9838-c4585878689a None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/users/3043616cabe84e879950bca9f05bb1de/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:16.237014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d20e8a-be40-4683-9838-c4585878689a None admin] RBAC: Authorizing `identity:create_grant(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29, user_id=3043616cabe84e879950bca9f05bb1de, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:16.238941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d20e8a-be40-4683-9838-c4585878689a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:16.241219 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:16.256627 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 119/230] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:58:16 2022] PUT /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/users/3043616cabe84e879950bca9f05bb1de/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:16.257378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d20e8a-be40-4683-9838-c4585878689a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:16.272352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bc6e5-893f-4a30-abf6-cd523f8d9490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:16.273103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bc6e5-893f-4a30-abf6-cd523f8d9490 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:16.273383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bc6e5-893f-4a30-abf6-cd523f8d9490 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:16.273679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bc6e5-893f-4a30-abf6-cd523f8d9490 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/users/3043616cabe84e879950bca9f05bb1de/roles/c59031d5db354a478ab7a9ac0000e098` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:16.279221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bc6e5-893f-4a30-abf6-cd523f8d9490 None admin] RBAC: Authorizing `identity:create_grant(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29, user_id=3043616cabe84e879950bca9f05bb1de, role_id=c59031d5db354a478ab7a9ac0000e098)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:16.283434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bc6e5-893f-4a30-abf6-cd523f8d9490 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:16.307678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 112/231] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:58:16 2022] PUT /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/users/3043616cabe84e879950bca9f05bb1de/roles/c59031d5db354a478ab7a9ac0000e098 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:16.409778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d20e8a-be40-4683-9838-c4585878689a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:16.411747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:16.454526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed59ee6-835f-4554-8662-c45467040f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:16.455216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed59ee6-835f-4554-8662-c45467040f81 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:16.455562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed59ee6-835f-4554-8662-c45467040f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:16.455923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed59ee6-835f-4554-8662-c45467040f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:16.539364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed59ee6-835f-4554-8662-c45467040f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:16.541039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed59ee6-835f-4554-8662-c45467040f81 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:16.648252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 120/232] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:16.654608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bc6e5-893f-4a30-abf6-cd523f8d9490 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:16.762447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bc6e5-893f-4a30-abf6-cd523f8d9490 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:16.813167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420185f-6e2d-4e73-a93f-3d0968fcbe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:16.813880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420185f-6e2d-4e73-a93f-3d0968fcbe67 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:16.814159 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420185f-6e2d-4e73-a93f-3d0968fcbe67 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:16.814431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420185f-6e2d-4e73-a93f-3d0968fcbe67 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:16.818355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420185f-6e2d-4e73-a93f-3d0968fcbe67 None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:16.819810 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420185f-6e2d-4e73-a93f-3d0968fcbe67 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:16.821461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 113/233] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:16 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:16.827814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed59ee6-835f-4554-8662-c45467040f81 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:16.830056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:16.953833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed59ee6-835f-4554-8662-c45467040f81 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:16.999650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975b293-5111-4161-a967-067827a0312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:17.000289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975b293-5111-4161-a967-067827a0312d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:17.000575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975b293-5111-4161-a967-067827a0312d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:17.000846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975b293-5111-4161-a967-067827a0312d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:17.001678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975b293-5111-4161-a967-067827a0312d None admin] RBAC: Adding query filter params (role.id=b320236412e649d9ab1e6787ef8a6870, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29, user.id=b537c3e416d24e45a7f60d553a090d54) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:17.001996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975b293-5111-4161-a967-067827a0312d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:17.003555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975b293-5111-4161-a967-067827a0312d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:17.012744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 121/234] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:16 2022] GET /identity/v3/role_assignments?user.id=b537c3e416d24e45a7f60d553a090d54&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:18.636482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080632e3-429f-47ce-b27b-1298fc04262c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:18.637515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080632e3-429f-47ce-b27b-1298fc04262c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:18.638553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080632e3-429f-47ce-b27b-1298fc04262c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:18.640206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 114/235] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:18.641873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422d810-1432-4618-8e00-35b739e14887 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:18.642645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422d810-1432-4618-8e00-35b739e14887 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:18.643143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422d810-1432-4618-8e00-35b739e14887 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:18.644642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 122/236] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:18.650050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea30ee6-50c2-413b-8d60-b445bd4e26a5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:18.650334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea30ee6-50c2-413b-8d60-b445bd4e26a5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:18.650609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea30ee6-50c2-413b-8d60-b445bd4e26a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:18.650842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0b81-efe0-4024-9ba1-f7c3fd516e47 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:18.651320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0b81-efe0-4024-9ba1-f7c3fd516e47 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:18.651782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0b81-efe0-4024-9ba1-f7c3fd516e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:18.675296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-350c0b81-efe0-4024-9ba1-f7c3fd516e47 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:18.676832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-350c0b81-efe0-4024-9ba1-f7c3fd516e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:18.680851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7ea30ee6-50c2-413b-8d60-b445bd4e26a5 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:18.681221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7ea30ee6-50c2-413b-8d60-b445bd4e26a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:18.742718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:18.753228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 123/237] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:18.758383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:18.791633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 115/238] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:19.042148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ace73e-7d7d-4d13-9c9b-a252c437c52c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.042787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ace73e-7d7d-4d13-9c9b-a252c437c52c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.043261 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ace73e-7d7d-4d13-9c9b-a252c437c52c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.045697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 124/239] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:19.051460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e164f-1ea5-4c2e-a6d0-5d5e317e50bd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.051746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e164f-1ea5-4c2e-a6d0-5d5e317e50bd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.052013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e164f-1ea5-4c2e-a6d0-5d5e317e50bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.082625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a10e164f-1ea5-4c2e-a6d0-5d5e317e50bd None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:19.083826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a10e164f-1ea5-4c2e-a6d0-5d5e317e50bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:19.089356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ace73e-7d7d-4d13-9c9b-a252c437c52c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.154096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 116/240] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:19.155397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c39e9-86b2-4df4-86de-a6b274944c30 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.155678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c39e9-86b2-4df4-86de-a6b274944c30 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.155945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c39e9-86b2-4df4-86de-a6b274944c30 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.157208 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 117/241] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:19.164198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efe673-90af-4fe7-98a1-36cad61da918 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.164478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efe673-90af-4fe7-98a1-36cad61da918 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.164754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efe673-90af-4fe7-98a1-36cad61da918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.183516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-82efe673-90af-4fe7-98a1-36cad61da918 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:19.184896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-82efe673-90af-4fe7-98a1-36cad61da918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:19.248049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ace73e-7d7d-4d13-9c9b-a252c437c52c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:19.256387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 118/242] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:19.257232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efe673-90af-4fe7-98a1-36cad61da918 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.289113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42432fc7-4415-4281-a942-09c2d3fc2682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:19.289815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432fc7-4415-4281-a942-09c2d3fc2682 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.290220 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432fc7-4415-4281-a942-09c2d3fc2682 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.290497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432fc7-4415-4281-a942-09c2d3fc2682 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.291903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42432fc7-4415-4281-a942-09c2d3fc2682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:19.293405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42432fc7-4415-4281-a942-09c2d3fc2682 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:19.295380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 125/243] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:19.302561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42432fc7-4415-4281-a942-09c2d3fc2682 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.333767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:19.420580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:19.455983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efe673-90af-4fe7-98a1-36cad61da918 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:19.475345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42432fc7-4415-4281-a942-09c2d3fc2682 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:19.499501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0edf8-e704-4a0a-8045-b885aff1cc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:19.500628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0edf8-e704-4a0a-8045-b885aff1cc00 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.500969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0edf8-e704-4a0a-8045-b885aff1cc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.501309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0edf8-e704-4a0a-8045-b885aff1cc00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.512308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0edf8-e704-4a0a-8045-b885aff1cc00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:19.516580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf9895-1b1b-4f4a-bd69-a757b0577823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:19.517432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf9895-1b1b-4f4a-bd69-a757b0577823 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.517959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf9895-1b1b-4f4a-bd69-a757b0577823 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.518408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf9895-1b1b-4f4a-bd69-a757b0577823 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-55c0edf8-e704-4a0a-8045-b885aff1cc00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:19.518513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:19.519324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:19.520122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 119/244] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:19.520768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0edf8-e704-4a0a-8045-b885aff1cc00 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.522226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf9895-1b1b-4f4a-bd69-a757b0577823 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:19.523929 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf9895-1b1b-4f4a-bd69-a757b0577823 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:19.550779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 126/245] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:58:19 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:19.557652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf9895-1b1b-4f4a-bd69-a757b0577823 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.636725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:19.640313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0edf8-e704-4a0a-8045-b885aff1cc00 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:19.684201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0410d-3561-48b5-abdd-cb6b0440ec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:19.685923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0410d-3561-48b5-abdd-cb6b0440ec8a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.686277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0410d-3561-48b5-abdd-cb6b0440ec8a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.686615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0410d-3561-48b5-abdd-cb6b0440ec8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.699591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0410d-3561-48b5-abdd-cb6b0440ec8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-83d0410d-3561-48b5-abdd-cb6b0440ec8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:19.705409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:19.706368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:19.707150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 120/246] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:19.708318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0410d-3561-48b5-abdd-cb6b0440ec8a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.736380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf9895-1b1b-4f4a-bd69-a757b0577823 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:19.759346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:19.777218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e399bf0-6012-407c-bce7-c142f4fe6bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:19.777887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399bf0-6012-407c-bce7-c142f4fe6bda None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.778166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399bf0-6012-407c-bce7-c142f4fe6bda None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.778974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e399bf0-6012-407c-bce7-c142f4fe6bda None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.779737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e399bf0-6012-407c-bce7-c142f4fe6bda None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:19.780045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e399bf0-6012-407c-bce7-c142f4fe6bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:19.781671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e399bf0-6012-407c-bce7-c142f4fe6bda None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:19.791343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 127/247] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:19.792018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e399bf0-6012-407c-bce7-c142f4fe6bda None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.835913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0410d-3561-48b5-abdd-cb6b0440ec8a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:19.876944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504f071-8673-4985-8c22-e0c50a9f075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:19.877584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f071-8673-4985-8c22-e0c50a9f075a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.877888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f071-8673-4985-8c22-e0c50a9f075a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.878185 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f071-8673-4985-8c22-e0c50a9f075a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.892779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504f071-8673-4985-8c22-e0c50a9f075a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e504f071-8673-4985-8c22-e0c50a9f075a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:19.899080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:19.900146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 121/248] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:19.901053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea1738-3f91-43bb-a1a4-53ab647a7981 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.901784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea1738-3f91-43bb-a1a4-53ab647a7981 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.901784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea1738-3f91-43bb-a1a4-53ab647a7981 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.905736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 122/249] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:19.905736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea1738-3f91-43bb-a1a4-53ab647a7981 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.911666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e399bf0-6012-407c-bce7-c142f4fe6bda None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:19.932559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:19.961161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97663c5-e502-4621-b771-22683e96fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:19.961846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97663c5-e502-4621-b771-22683e96fc27 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.962126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97663c5-e502-4621-b771-22683e96fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.962398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97663c5-e502-4621-b771-22683e96fc27 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.963057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97663c5-e502-4621-b771-22683e96fc27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:19.963359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97663c5-e502-4621-b771-22683e96fc27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:19.964724 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97663c5-e502-4621-b771-22683e96fc27 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:19.976288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 128/250] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:19.977249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97663c5-e502-4621-b771-22683e96fc27 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.033119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea1738-3f91-43bb-a1a4-53ab647a7981 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.038433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:20.082617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c2a26-1cdf-4317-a475-91e6f078ed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.083821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c2a26-1cdf-4317-a475-91e6f078ed03 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.084278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c2a26-1cdf-4317-a475-91e6f078ed03 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.084851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c2a26-1cdf-4317-a475-91e6f078ed03 None admin] PATH_INFO: `/v3/users/a5bea5eac9d84912a7aa8da16833ab6f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.102701 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c2a26-1cdf-4317-a475-91e6f078ed03 None admin] RBAC: Authorizing `identity:get_user(user_id=a5bea5eac9d84912a7aa8da16833ab6f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.104038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97663c5-e502-4621-b771-22683e96fc27 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.104643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c2a26-1cdf-4317-a475-91e6f078ed03 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.108025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 123/251] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:19 2022] GET /identity/v3/users/a5bea5eac9d84912a7aa8da16833ab6f => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:20.109480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6be5-2599-4c60-bb7b-b0f9a1543167 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.109963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6be5-2599-4c60-bb7b-b0f9a1543167 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.110410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6be5-2599-4c60-bb7b-b0f9a1543167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.133319 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-419a6be5-2599-4c60-bb7b-b0f9a1543167 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:20.134546 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-419a6be5-2599-4c60-bb7b-b0f9a1543167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:20.145881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeef622-529d-4735-83d2-c8fbcf3e7f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.147356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeef622-529d-4735-83d2-c8fbcf3e7f58 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.147786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeef622-529d-4735-83d2-c8fbcf3e7f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.148225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeef622-529d-4735-83d2-c8fbcf3e7f58 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.149258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeef622-529d-4735-83d2-c8fbcf3e7f58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:20.149732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeef622-529d-4735-83d2-c8fbcf3e7f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.151964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeef622-529d-4735-83d2-c8fbcf3e7f58 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.162910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 129/252] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:20.163941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeef622-529d-4735-83d2-c8fbcf3e7f58 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.216956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 124/253] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:20.218563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a6be5-2599-4c60-bb7b-b0f9a1543167 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.231280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:20.335578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeef622-529d-4735-83d2-c8fbcf3e7f58 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.352524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a6be5-2599-4c60-bb7b-b0f9a1543167 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.354243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:20.406206 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec10d8-73c7-4f0c-bbb3-95b2e5c20845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.407029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec10d8-73c7-4f0c-bbb3-95b2e5c20845 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.407316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec10d8-73c7-4f0c-bbb3-95b2e5c20845 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.407579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec10d8-73c7-4f0c-bbb3-95b2e5c20845 None admin] PATH_INFO: `/v3/users/3043616cabe84e879950bca9f05bb1de` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.409265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec10d8-73c7-4f0c-bbb3-95b2e5c20845 None admin] RBAC: Authorizing `identity:get_user(user_id=3043616cabe84e879950bca9f05bb1de)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.410722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec10d8-73c7-4f0c-bbb3-95b2e5c20845 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.416603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 130/254] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:20 2022] GET /identity/v3/users/3043616cabe84e879950bca9f05bb1de => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:20.417912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec10d8-73c7-4f0c-bbb3-95b2e5c20845 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.423576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9b393-8f71-41e8-ac05-5b8ab5e4048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.424233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9b393-8f71-41e8-ac05-5b8ab5e4048c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.424512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9b393-8f71-41e8-ac05-5b8ab5e4048c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.424780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9b393-8f71-41e8-ac05-5b8ab5e4048c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.505611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9b393-8f71-41e8-ac05-5b8ab5e4048c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.507086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9b393-8f71-41e8-ac05-5b8ab5e4048c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.518230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:20.608732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec10d8-73c7-4f0c-bbb3-95b2e5c20845 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.624212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 125/255] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:20.624935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9b393-8f71-41e8-ac05-5b8ab5e4048c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.649431 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085c18c-15a1-4849-b318-2294cce37b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.650457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085c18c-15a1-4849-b318-2294cce37b73 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.650938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085c18c-15a1-4849-b318-2294cce37b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.651410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085c18c-15a1-4849-b318-2294cce37b73 None admin] PATH_INFO: `/v3/users/3043616cabe84e879950bca9f05bb1de` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.652888 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085c18c-15a1-4849-b318-2294cce37b73 None admin] RBAC: Authorizing `identity:get_user(user_id=3043616cabe84e879950bca9f05bb1de)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.655365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085c18c-15a1-4849-b318-2294cce37b73 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.657138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 131/256] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:20 2022] GET /identity/v3/users/3043616cabe84e879950bca9f05bb1de => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:20.657748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085c18c-15a1-4849-b318-2294cce37b73 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.713599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:20.746501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9b393-8f71-41e8-ac05-5b8ab5e4048c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.757551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:20.786261 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f0ddd-aa46-4081-8d68-1d8f609d4e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.787087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0ddd-aa46-4081-8d68-1d8f609d4e26 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.787544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0ddd-aa46-4081-8d68-1d8f609d4e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.788003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0ddd-aa46-4081-8d68-1d8f609d4e26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.795571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085c18c-15a1-4849-b318-2294cce37b73 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.844666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e925ec-3bc3-4168-9ddd-622cbba5741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.845308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e925ec-3bc3-4168-9ddd-622cbba5741e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.845590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e925ec-3bc3-4168-9ddd-622cbba5741e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.845980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e925ec-3bc3-4168-9ddd-622cbba5741e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.861915 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e925ec-3bc3-4168-9ddd-622cbba5741e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:20.864906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f0ddd-aa46-4081-8d68-1d8f609d4e26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.866896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f0ddd-aa46-4081-8d68-1d8f609d4e26 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e4e925ec-3bc3-4168-9ddd-622cbba5741e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:20.867000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:20.867836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:20.868595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 132/257] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:20.869241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e925ec-3bc3-4168-9ddd-622cbba5741e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.980090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 126/258] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:20.981328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f0ddd-aa46-4081-8d68-1d8f609d4e26 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.995998 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:21.010450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e925ec-3bc3-4168-9ddd-622cbba5741e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.013127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:21.048858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01151f-63aa-4d8b-a2ae-6284d02231fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.049499 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01151f-63aa-4d8b-a2ae-6284d02231fc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.049834 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01151f-63aa-4d8b-a2ae-6284d02231fc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.050085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01151f-63aa-4d8b-a2ae-6284d02231fc None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.051341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01151f-63aa-4d8b-a2ae-6284d02231fc None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.052796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01151f-63aa-4d8b-a2ae-6284d02231fc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.054795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 133/259] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:20 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:21.055581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01151f-63aa-4d8b-a2ae-6284d02231fc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.119916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f0ddd-aa46-4081-8d68-1d8f609d4e26 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.169035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01151f-63aa-4d8b-a2ae-6284d02231fc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.170984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2508d96-a915-418e-a82e-9033a33fb32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.171766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508d96-a915-418e-a82e-9033a33fb32c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.172042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508d96-a915-418e-a82e-9033a33fb32c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.173138 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508d96-a915-418e-a82e-9033a33fb32c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.216797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10665f2d-6121-4df5-8197-32f5071ca371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.217499 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10665f2d-6121-4df5-8197-32f5071ca371 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.217874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10665f2d-6121-4df5-8197-32f5071ca371 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.218218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10665f2d-6121-4df5-8197-32f5071ca371 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.218945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10665f2d-6121-4df5-8197-32f5071ca371 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:21.219315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10665f2d-6121-4df5-8197-32f5071ca371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.221358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10665f2d-6121-4df5-8197-32f5071ca371 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.233600 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 134/260] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:21.234613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10665f2d-6121-4df5-8197-32f5071ca371 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.254634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2508d96-a915-418e-a82e-9033a33fb32c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.256767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2508d96-a915-418e-a82e-9033a33fb32c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.269825 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:21.274023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:21.372328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10665f2d-6121-4df5-8197-32f5071ca371 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.382749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 127/261] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:21.384037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2508d96-a915-418e-a82e-9033a33fb32c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.415680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d973c-9a6e-4c09-8fa5-d24516e94d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.416942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d973c-9a6e-4c09-8fa5-d24516e94d56 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.417863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d973c-9a6e-4c09-8fa5-d24516e94d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.418600 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d973c-9a6e-4c09-8fa5-d24516e94d56 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.420892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d973c-9a6e-4c09-8fa5-d24516e94d56 None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.423228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d973c-9a6e-4c09-8fa5-d24516e94d56 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.430744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 135/262] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:21.430744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d973c-9a6e-4c09-8fa5-d24516e94d56 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.509536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2508d96-a915-418e-a82e-9033a33fb32c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.523308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:21.552038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13040714-d720-4166-acb0-558406b7c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.552927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:21.553867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040714-d720-4166-acb0-558406b7c358 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.554447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040714-d720-4166-acb0-558406b7c358 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.554915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040714-d720-4166-acb0-558406b7c358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.555839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13040714-d720-4166-acb0-558406b7c358 None admin] RBAC: Adding query filter params (role.id=882e144ddabb436ba7e9c2130cf9cb49, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29, user.id=a5bea5eac9d84912a7aa8da16833ab6f) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:21.556364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13040714-d720-4166-acb0-558406b7c358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.556481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d973c-9a6e-4c09-8fa5-d24516e94d56 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.558164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13040714-d720-4166-acb0-558406b7c358 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.569971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 128/263] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/role_assignments?user.id=a5bea5eac9d84912a7aa8da16833ab6f&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=882e144ddabb436ba7e9c2130cf9cb49 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:21.571309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13040714-d720-4166-acb0-558406b7c358 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.594369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308511f-2a39-4f9b-a988-846b9499ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.595056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308511f-2a39-4f9b-a988-846b9499ac22 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.595353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308511f-2a39-4f9b-a988-846b9499ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.596191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308511f-2a39-4f9b-a988-846b9499ac22 None admin] PATH_INFO: `/v3/users/b537c3e416d24e45a7f60d553a090d54` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.597133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308511f-2a39-4f9b-a988-846b9499ac22 None admin] RBAC: Authorizing `identity:get_user(user_id=b537c3e416d24e45a7f60d553a090d54)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.599012 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308511f-2a39-4f9b-a988-846b9499ac22 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.601189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 136/264] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/users/b537c3e416d24e45a7f60d553a090d54 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:21.602122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308511f-2a39-4f9b-a988-846b9499ac22 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.725283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308511f-2a39-4f9b-a988-846b9499ac22 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.763958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a744b-d4c9-49ee-87f8-54c9e26d2af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.764761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a744b-d4c9-49ee-87f8-54c9e26d2af4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.765140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a744b-d4c9-49ee-87f8-54c9e26d2af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.765487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a744b-d4c9-49ee-87f8-54c9e26d2af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.766352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a744b-d4c9-49ee-87f8-54c9e26d2af4 None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29, user.id=3043616cabe84e879950bca9f05bb1de) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:21.766835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a744b-d4c9-49ee-87f8-54c9e26d2af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.768430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a744b-d4c9-49ee-87f8-54c9e26d2af4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.774720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 137/265] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/role_assignments?user.id=3043616cabe84e879950bca9f05bb1de&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:21.775735 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a744b-d4c9-49ee-87f8-54c9e26d2af4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.775996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13040714-d720-4166-acb0-558406b7c358 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.811854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:21.859421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafff102-9943-474b-a29a-e3e9ab206e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.860075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff102-9943-474b-a29a-e3e9ab206e6f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.860353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff102-9943-474b-a29a-e3e9ab206e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.860625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff102-9943-474b-a29a-e3e9ab206e6f None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.866513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafff102-9943-474b-a29a-e3e9ab206e6f None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.868013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafff102-9943-474b-a29a-e3e9ab206e6f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.869784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 129/266] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:21.877012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafff102-9943-474b-a29a-e3e9ab206e6f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.893059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a744b-d4c9-49ee-87f8-54c9e26d2af4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.932955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2930d-3fb0-41a0-b4fe-87d265b3830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.933514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2930d-3fb0-41a0-b4fe-87d265b3830e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.933819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2930d-3fb0-41a0-b4fe-87d265b3830e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.934092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2930d-3fb0-41a0-b4fe-87d265b3830e None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.936510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2930d-3fb0-41a0-b4fe-87d265b3830e None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.938061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2930d-3fb0-41a0-b4fe-87d265b3830e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.940078 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 138/267] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:21.946326 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2930d-3fb0-41a0-b4fe-87d265b3830e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.958159 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:22.058941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafff102-9943-474b-a29a-e3e9ab206e6f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:22.068837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:22.073450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2930d-3fb0-41a0-b4fe-87d265b3830e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:22.114227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0332d-18d4-4f5f-b192-347346e56994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:22.114862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0332d-18d4-4f5f-b192-347346e56994 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:22.115190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0332d-18d4-4f5f-b192-347346e56994 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:22.115472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0332d-18d4-4f5f-b192-347346e56994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:22.115934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab522ed4-894e-4895-81cb-2321852e22d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:22.116212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0332d-18d4-4f5f-b192-347346e56994 None admin] RBAC: Adding query filter params (role.id=c59031d5db354a478ab7a9ac0000e098, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29, user.id=3043616cabe84e879950bca9f05bb1de) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:22.116526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0332d-18d4-4f5f-b192-347346e56994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:22.117053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab522ed4-894e-4895-81cb-2321852e22d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:22.117481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab522ed4-894e-4895-81cb-2321852e22d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:22.117940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab522ed4-894e-4895-81cb-2321852e22d6 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/users/b537c3e416d24e45a7f60d553a090d54/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:22.118062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0332d-18d4-4f5f-b192-347346e56994 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:22.120252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab522ed4-894e-4895-81cb-2321852e22d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29, user_id=b537c3e416d24e45a7f60d553a090d54, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:22.121880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab522ed4-894e-4895-81cb-2321852e22d6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:22.125345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 130/268] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/role_assignments?user.id=3043616cabe84e879950bca9f05bb1de&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=c59031d5db354a478ab7a9ac0000e098 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:22.127244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bce45-0f7f-498c-a35b-ced7e5d21229 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:22.127244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bce45-0f7f-498c-a35b-ced7e5d21229 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:22.127445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bce45-0f7f-498c-a35b-ced7e5d21229 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:22.129086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 131/269] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:22.134874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef2b2b-53b0-4ebc-95b3-5d3c8bfc51b8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:22.135086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef2b2b-53b0-4ebc-95b3-5d3c8bfc51b8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:22.135353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef2b2b-53b0-4ebc-95b3-5d3c8bfc51b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:22.145773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 139/270] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:58:21 2022] PUT /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/users/b537c3e416d24e45a7f60d553a090d54/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:22.157079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-11ef2b2b-53b0-4ebc-95b3-5d3c8bfc51b8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:22.158548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-11ef2b2b-53b0-4ebc-95b3-5d3c8bfc51b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:22.245363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 132/271] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:22.282608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350ea7-f2c1-4c8f-929c-510a996cb118 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:22.283241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350ea7-f2c1-4c8f-929c-510a996cb118 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:22.283718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350ea7-f2c1-4c8f-929c-510a996cb118 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:22.285678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 140/272] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:22.291386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83581d7d-6c3f-4124-ad19-bb144aefb312 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:22.291690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83581d7d-6c3f-4124-ad19-bb144aefb312 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:22.291940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83581d7d-6c3f-4124-ad19-bb144aefb312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:22.318881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-83581d7d-6c3f-4124-ad19-bb144aefb312 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:22.320146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-83581d7d-6c3f-4124-ad19-bb144aefb312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:22.362038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:22.417033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 133/273] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:22.584781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36350ea7-f2c1-4c8f-929c-510a996cb118 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:22.715116 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36350ea7-f2c1-4c8f-929c-510a996cb118 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:22.717066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83581d7d-6c3f-4124-ad19-bb144aefb312 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:22.766966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdbf3-3991-44e5-bdb8-e37ea873ff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:22.767608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdbf3-3991-44e5-bdb8-e37ea873ff81 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:22.767885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdbf3-3991-44e5-bdb8-e37ea873ff81 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:22.768274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdbf3-3991-44e5-bdb8-e37ea873ff81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:22.781271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bdbf3-3991-44e5-bdb8-e37ea873ff81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-bd1bdbf3-3991-44e5-bdb8-e37ea873ff81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:22.786885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:22.787768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:22.788541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 141/274] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:22.795108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdbf3-3991-44e5-bdb8-e37ea873ff81 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:22.821836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:22.849378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83581d7d-6c3f-4124-ad19-bb144aefb312 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:22.887345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684ffb0-8724-4e4d-9354-6bcacdb20926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:22.888256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684ffb0-8724-4e4d-9354-6bcacdb20926 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:22.888683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684ffb0-8724-4e4d-9354-6bcacdb20926 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:22.889163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684ffb0-8724-4e4d-9354-6bcacdb20926 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:22.890798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684ffb0-8724-4e4d-9354-6bcacdb20926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:22.892489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684ffb0-8724-4e4d-9354-6bcacdb20926 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:22.897976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 134/275] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:22.900234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684ffb0-8724-4e4d-9354-6bcacdb20926 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:22.916370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdbf3-3991-44e5-bdb8-e37ea873ff81 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:22.935150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:22.958040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66e63e-6b9a-4109-8d78-e84ed1f116ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:22.958652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66e63e-6b9a-4109-8d78-e84ed1f116ba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:22.958930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66e63e-6b9a-4109-8d78-e84ed1f116ba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:22.959204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66e63e-6b9a-4109-8d78-e84ed1f116ba None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:22.959873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66e63e-6b9a-4109-8d78-e84ed1f116ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:22.960168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66e63e-6b9a-4109-8d78-e84ed1f116ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:22.961984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66e63e-6b9a-4109-8d78-e84ed1f116ba None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:22.972381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 142/276] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:22.978357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66e63e-6b9a-4109-8d78-e84ed1f116ba None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:23.022656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684ffb0-8724-4e4d-9354-6bcacdb20926 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:23.063431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7850a19-d766-4277-b4d0-9d9dfd0cf8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:23.064440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7850a19-d766-4277-b4d0-9d9dfd0cf8d0 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:23.064935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7850a19-d766-4277-b4d0-9d9dfd0cf8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:23.065429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7850a19-d766-4277-b4d0-9d9dfd0cf8d0 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:23.066314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7850a19-d766-4277-b4d0-9d9dfd0cf8d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:23.067969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7850a19-d766-4277-b4d0-9d9dfd0cf8d0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:23.075826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:23.097682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 135/277] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:58:22 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:58:23.098902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66e63e-6b9a-4109-8d78-e84ed1f116ba None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:23.146943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588918e-d0aa-4b81-ba1f-e1fb6744fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:23.147934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588918e-d0aa-4b81-ba1f-e1fb6744fabe None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:23.148464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588918e-d0aa-4b81-ba1f-e1fb6744fabe None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:23.148933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588918e-d0aa-4b81-ba1f-e1fb6744fabe None admin] PATH_INFO: `/v3/users/8b547d40976a4562b640ba98db3c5fef` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:23.166480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588918e-d0aa-4b81-ba1f-e1fb6744fabe None admin] RBAC: Authorizing `identity:get_user(user_id=8b547d40976a4562b640ba98db3c5fef)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:23.168356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588918e-d0aa-4b81-ba1f-e1fb6744fabe None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:23.171434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 143/278] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:22 2022] GET /identity/v3/users/8b547d40976a4562b640ba98db3c5fef => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:23.177606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7850a19-d766-4277-b4d0-9d9dfd0cf8d0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:23.286041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:23.300780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7850a19-d766-4277-b4d0-9d9dfd0cf8d0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:23.337007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178797d-94a0-4a86-9b99-78f03d5b47d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:23.338029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178797d-94a0-4a86-9b99-78f03d5b47d1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:23.338506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178797d-94a0-4a86-9b99-78f03d5b47d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:23.338973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178797d-94a0-4a86-9b99-78f03d5b47d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:23.339897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178797d-94a0-4a86-9b99-78f03d5b47d1 None admin] RBAC: Adding query filter params (role.id=b320236412e649d9ab1e6787ef8a6870, user.id=8b547d40976a4562b640ba98db3c5fef, scope.system=all) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:23.340403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178797d-94a0-4a86-9b99-78f03d5b47d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:23.342533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178797d-94a0-4a86-9b99-78f03d5b47d1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:23.348543 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 136/279] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Sep 19 11:58:23 2022] GET /identity/v3/role_assignments?user.id=8b547d40976a4562b640ba98db3c5fef&scope.system=all&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:24.494910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa510c3-b3ca-431e-8efa-b83bfcce686c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:24.495422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa510c3-b3ca-431e-8efa-b83bfcce686c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:24.495527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa510c3-b3ca-431e-8efa-b83bfcce686c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:24.496786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 144/280] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:24.502245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b57bd-97bf-4c68-8b3c-a87323fd3ab3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:24.502635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b57bd-97bf-4c68-8b3c-a87323fd3ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:24.502794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b57bd-97bf-4c68-8b3c-a87323fd3ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:24.525046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-929b57bd-97bf-4c68-8b3c-a87323fd3ab3 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:24.526291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-929b57bd-97bf-4c68-8b3c-a87323fd3ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:24.616233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 137/281] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:24.855800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340a9e0-d870-4dc9-84fb-078fc604c4bd None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:24.856188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340a9e0-d870-4dc9-84fb-078fc604c4bd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:24.856922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340a9e0-d870-4dc9-84fb-078fc604c4bd None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:24.858623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 145/282] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:24.864327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81d8e4-fcec-47e4-92e2-042773240f85 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:24.864610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81d8e4-fcec-47e4-92e2-042773240f85 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:24.864881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81d8e4-fcec-47e4-92e2-042773240f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:24.890571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cd81d8e4-fcec-47e4-92e2-042773240f85 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:24.891745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cd81d8e4-fcec-47e4-92e2-042773240f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:24.956756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340a9e0-d870-4dc9-84fb-078fc604c4bd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:24.978681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 138/283] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:25.097286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340a9e0-d870-4dc9-84fb-078fc604c4bd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:25.132024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b89df2-4a12-4c34-bf55-627482f19a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:25.132590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b89df2-4a12-4c34-bf55-627482f19a78 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:25.132865 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b89df2-4a12-4c34-bf55-627482f19a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:25.133134 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b89df2-4a12-4c34-bf55-627482f19a78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:25.144699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:25.148357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b89df2-4a12-4c34-bf55-627482f19a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-67b89df2-4a12-4c34-bf55-627482f19a78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:25.156187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:25.157290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:25.158107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 146/284] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:25.164813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81d8e4-fcec-47e4-92e2-042773240f85 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:25.191329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:25.289289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81d8e4-fcec-47e4-92e2-042773240f85 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:25.322313 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b89df2-4a12-4c34-bf55-627482f19a78 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:25.327077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f746fe-00ca-437c-9bde-0be19afdd1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:25.327732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f746fe-00ca-437c-9bde-0be19afdd1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:25.328266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f746fe-00ca-437c-9bde-0be19afdd1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:25.328548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f746fe-00ca-437c-9bde-0be19afdd1f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:25.329225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f746fe-00ca-437c-9bde-0be19afdd1f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:25.329531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f746fe-00ca-437c-9bde-0be19afdd1f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:25.330939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f746fe-00ca-437c-9bde-0be19afdd1f5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:25.342504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 139/285] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:25.363642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f746fe-00ca-437c-9bde-0be19afdd1f5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:25.447192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b89df2-4a12-4c34-bf55-627482f19a78 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:25.498550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa0c62-86c2-4981-8737-a9ed3998f2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:25.499312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa0c62-86c2-4981-8737-a9ed3998f2bb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:25.499476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa0c62-86c2-4981-8737-a9ed3998f2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:25.499734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa0c62-86c2-4981-8737-a9ed3998f2bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:25.520406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa0c62-86c2-4981-8737-a9ed3998f2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-16aa0c62-86c2-4981-8737-a9ed3998f2bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:25.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:25.532353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:25.533142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 147/286] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:25.534465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:25.540583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa0c62-86c2-4981-8737-a9ed3998f2bb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:25.586458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f746fe-00ca-437c-9bde-0be19afdd1f5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:25.660652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96566dd1-0b6a-4d17-b2aa-7b3dc286ab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:25.661292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96566dd1-0b6a-4d17-b2aa-7b3dc286ab49 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:25.661569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96566dd1-0b6a-4d17-b2aa-7b3dc286ab49 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:25.664449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96566dd1-0b6a-4d17-b2aa-7b3dc286ab49 None admin] PATH_INFO: `/v3/users/a5bea5eac9d84912a7aa8da16833ab6f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:25.664575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:25.664656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96566dd1-0b6a-4d17-b2aa-7b3dc286ab49 None admin] RBAC: Authorizing `identity:get_user(user_id=a5bea5eac9d84912a7aa8da16833ab6f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:25.665996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96566dd1-0b6a-4d17-b2aa-7b3dc286ab49 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:25.679366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 140/287] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:25 2022] GET /identity/v3/users/a5bea5eac9d84912a7aa8da16833ab6f => generated 297 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:25.680342 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96566dd1-0b6a-4d17-b2aa-7b3dc286ab49 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:25.727483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa0c62-86c2-4981-8737-a9ed3998f2bb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:25.779411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cbb58-45b9-4bc8-a3e2-1017a2e975fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:25.780071 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cbb58-45b9-4bc8-a3e2-1017a2e975fd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:25.780351 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cbb58-45b9-4bc8-a3e2-1017a2e975fd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:25.780617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cbb58-45b9-4bc8-a3e2-1017a2e975fd None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:25.781342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cbb58-45b9-4bc8-a3e2-1017a2e975fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:25.781654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cbb58-45b9-4bc8-a3e2-1017a2e975fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:25.783146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cbb58-45b9-4bc8-a3e2-1017a2e975fd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:25.808826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 148/288] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:25.810897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cbb58-45b9-4bc8-a3e2-1017a2e975fd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:25.824852 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96566dd1-0b6a-4d17-b2aa-7b3dc286ab49 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:25.866941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aa481-a073-4ec6-9f2e-c41944dae132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:25.867949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa481-a073-4ec6-9f2e-c41944dae132 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:25.868548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa481-a073-4ec6-9f2e-c41944dae132 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:25.869022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa481-a073-4ec6-9f2e-c41944dae132 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:25.878385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05aa481-a073-4ec6-9f2e-c41944dae132 None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:25.880135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05aa481-a073-4ec6-9f2e-c41944dae132 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:25.882403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 141/289] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:25 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:25.888415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aa481-a073-4ec6-9f2e-c41944dae132 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:25.912118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:25.975790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cbb58-45b9-4bc8-a3e2-1017a2e975fd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:26.008571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:26.010167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aa481-a073-4ec6-9f2e-c41944dae132 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:26.021941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cfed1-34e2-4c29-8f55-3b2599b35e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:26.022445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cfed1-34e2-4c29-8f55-3b2599b35e7d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.022725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cfed1-34e2-4c29-8f55-3b2599b35e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.023040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cfed1-34e2-4c29-8f55-3b2599b35e7d None admin] PATH_INFO: `/v3/users/b537c3e416d24e45a7f60d553a090d54` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.024110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cfed1-34e2-4c29-8f55-3b2599b35e7d None admin] RBAC: Authorizing `identity:get_user(user_id=b537c3e416d24e45a7f60d553a090d54)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:26.026282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cfed1-34e2-4c29-8f55-3b2599b35e7d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:26.028320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 149/290] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:25 2022] GET /identity/v3/users/b537c3e416d24e45a7f60d553a090d54 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:26.033858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45de8-cdf4-45f9-adb9-cc478182612a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.034150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45de8-cdf4-45f9-adb9-cc478182612a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.034428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45de8-cdf4-45f9-adb9-cc478182612a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.040070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 150/291] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:26.040070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9bb9-6b90-4855-9d11-426f8171fcfc None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.040070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9bb9-6b90-4855-9d11-426f8171fcfc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.040070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9bb9-6b90-4855-9d11-426f8171fcfc None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.040070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 151/292] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:26.040560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b9bb9-6b90-4855-9d11-426f8171fcfc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:26.053078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaaa5c-7797-4af7-8208-10e8c7e2e9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:26.053777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaaa5c-7797-4af7-8208-10e8c7e2e9fd None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.054070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaaa5c-7797-4af7-8208-10e8c7e2e9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.054323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaaa5c-7797-4af7-8208-10e8c7e2e9fd None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/users/a5bea5eac9d84912a7aa8da16833ab6f/roles/882e144ddabb436ba7e9c2130cf9cb49` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.056180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaaa5c-7797-4af7-8208-10e8c7e2e9fd None admin] RBAC: Authorizing `identity:create_grant(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29, user_id=a5bea5eac9d84912a7aa8da16833ab6f, role_id=882e144ddabb436ba7e9c2130cf9cb49)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:26.057611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaaa5c-7797-4af7-8208-10e8c7e2e9fd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:26.072188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 142/293] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:58:25 2022] PUT /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/users/a5bea5eac9d84912a7aa8da16833ab6f/roles/882e144ddabb436ba7e9c2130cf9cb49 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:58:26.074879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6380b-22c5-4835-b4d3-cc26440fc328 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.075946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6380b-22c5-4835-b4d3-cc26440fc328 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.076191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6380b-22c5-4835-b4d3-cc26440fc328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.104592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fff6380b-22c5-4835-b4d3-cc26440fc328 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:26.105926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fff6380b-22c5-4835-b4d3-cc26440fc328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:26.172040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b9bb9-6b90-4855-9d11-426f8171fcfc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:26.179491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:26.186193 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 143/294] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:26.187513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c90f2-ecda-45d6-9079-4c9af6c21b2f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.188027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c90f2-ecda-45d6-9079-4c9af6c21b2f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.189014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c90f2-ecda-45d6-9079-4c9af6c21b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.210236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-097c90f2-ecda-45d6-9079-4c9af6c21b2f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:26.211453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-097c90f2-ecda-45d6-9079-4c9af6c21b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:26.216673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc32cd-5c28-493a-a3a0-ff01ceb140ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:26.217667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc32cd-5c28-493a-a3a0-ff01ceb140ff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.218171 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc32cd-5c28-493a-a3a0-ff01ceb140ff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.218647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc32cd-5c28-493a-a3a0-ff01ceb140ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.293685 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 144/295] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:26.296367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d3a7d-1a4b-4c1e-a49c-b1f259839055 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.296834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d3a7d-1a4b-4c1e-a49c-b1f259839055 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.297223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d3a7d-1a4b-4c1e-a49c-b1f259839055 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.298679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 145/296] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:26.303360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:26.307050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9358-0fb0-49b6-8395-8fb88b70946d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.307572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9358-0fb0-49b6-8395-8fb88b70946d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.308063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9358-0fb0-49b6-8395-8fb88b70946d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.330175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d30e9358-0fb0-49b6-8395-8fb88b70946d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:26.331883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d30e9358-0fb0-49b6-8395-8fb88b70946d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:26.346671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc32cd-5c28-493a-a3a0-ff01ceb140ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:26.348158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc32cd-5c28-493a-a3a0-ff01ceb140ff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:26.409992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 146/297] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:26.463647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e9358-0fb0-49b6-8395-8fb88b70946d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:26.492342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 152/298] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:26.498506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc32cd-5c28-493a-a3a0-ff01ceb140ff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:26.532629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:26.578250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e9358-0fb0-49b6-8395-8fb88b70946d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:26.617010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ee2c1-45ce-4b3e-bc96-0719031ca0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:26.618027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ee2c1-45ce-4b3e-bc96-0719031ca0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.618507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ee2c1-45ce-4b3e-bc96-0719031ca0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.618633 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:26.619488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ee2c1-45ce-4b3e-bc96-0719031ca0f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.631571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc32cd-5c28-493a-a3a0-ff01ceb140ff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:26.632117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ee2c1-45ce-4b3e-bc96-0719031ca0f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-030ee2c1-45ce-4b3e-bc96-0719031ca0f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:26.637248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:26.638929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:26.639728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:26.642063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 147/299] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:26.647538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ee2c1-45ce-4b3e-bc96-0719031ca0f1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:26.673308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb86e5e-8b15-4c01-9024-ba3d3ace18ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:26.673984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb86e5e-8b15-4c01-9024-ba3d3ace18ba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.674263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb86e5e-8b15-4c01-9024-ba3d3ace18ba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.674533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb86e5e-8b15-4c01-9024-ba3d3ace18ba None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.675661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb86e5e-8b15-4c01-9024-ba3d3ace18ba None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:26.677094 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb86e5e-8b15-4c01-9024-ba3d3ace18ba None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:26.680095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 153/300] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:26 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:26.685675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb86e5e-8b15-4c01-9024-ba3d3ace18ba None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:26.774048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ee2c1-45ce-4b3e-bc96-0719031ca0f1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:26.797577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:26.812663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb86e5e-8b15-4c01-9024-ba3d3ace18ba None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:26.814757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3fe0-d1b2-4981-9417-ef3fd486edd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:26.816172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3fe0-d1b2-4981-9417-ef3fd486edd3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.816459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3fe0-d1b2-4981-9417-ef3fd486edd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.816762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3fe0-d1b2-4981-9417-ef3fd486edd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.828321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e3fe0-d1b2-4981-9417-ef3fd486edd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-844e3fe0-d1b2-4981-9417-ef3fd486edd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:26.833235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:26.834320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 148/301] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:26.839947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3fe0-d1b2-4981-9417-ef3fd486edd3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:26.857264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45a105-4bbd-4962-90ef-dc8ed16cedbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:26.858103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a105-4bbd-4962-90ef-dc8ed16cedbb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.858619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a105-4bbd-4962-90ef-dc8ed16cedbb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.858895 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a105-4bbd-4962-90ef-dc8ed16cedbb None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.859622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45a105-4bbd-4962-90ef-dc8ed16cedbb None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:26.859932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45a105-4bbd-4962-90ef-dc8ed16cedbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:26.861407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45a105-4bbd-4962-90ef-dc8ed16cedbb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:26.875641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 154/302] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:26.876523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45a105-4bbd-4962-90ef-dc8ed16cedbb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:26.900094 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:26.944206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3fe0-d1b2-4981-9417-ef3fd486edd3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:26.980941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0657830-4007-4e00-910f-1b44110780e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:26.982232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0657830-4007-4e00-910f-1b44110780e2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:26.982520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0657830-4007-4e00-910f-1b44110780e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:26.982800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0657830-4007-4e00-910f-1b44110780e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:26.983524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0657830-4007-4e00-910f-1b44110780e2 None admin] RBAC: Adding query filter params (role.id=b320236412e649d9ab1e6787ef8a6870, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29, user.id=b537c3e416d24e45a7f60d553a090d54) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:26.983831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0657830-4007-4e00-910f-1b44110780e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:26.984988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45a105-4bbd-4962-90ef-dc8ed16cedbb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:26.985271 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0657830-4007-4e00-910f-1b44110780e2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:26.991064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 149/303] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:26 2022] GET /identity/v3/role_assignments?user.id=b537c3e416d24e45a7f60d553a090d54&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:26.998967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0657830-4007-4e00-910f-1b44110780e2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:27.029597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626fe2-4dfb-45aa-9d7f-d4c29d96a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:27.031105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626fe2-4dfb-45aa-9d7f-d4c29d96a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:27.031532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626fe2-4dfb-45aa-9d7f-d4c29d96a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:27.031900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626fe2-4dfb-45aa-9d7f-d4c29d96a7d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:27.033547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac626fe2-4dfb-45aa-9d7f-d4c29d96a7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:27.035810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac626fe2-4dfb-45aa-9d7f-d4c29d96a7d4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:27.042332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 155/304] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:27.042332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626fe2-4dfb-45aa-9d7f-d4c29d96a7d4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:27.064043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:27.131188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0657830-4007-4e00-910f-1b44110780e2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:27.169337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b5b0d-91b7-435f-a594-bb4479efad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:27.170246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b5b0d-91b7-435f-a594-bb4479efad03 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:27.170691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b5b0d-91b7-435f-a594-bb4479efad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:27.171105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b5b0d-91b7-435f-a594-bb4479efad03 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:27.171215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:27.172009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b5b0d-91b7-435f-a594-bb4479efad03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:27.172446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b5b0d-91b7-435f-a594-bb4479efad03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:27.174846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b5b0d-91b7-435f-a594-bb4479efad03 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:27.185942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 150/305] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:27.186930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b5b0d-91b7-435f-a594-bb4479efad03 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:27.187977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626fe2-4dfb-45aa-9d7f-d4c29d96a7d4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:27.229186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7d14-1f97-4705-912e-c417b09d770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:27.229956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7d14-1f97-4705-912e-c417b09d770a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:27.230242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7d14-1f97-4705-912e-c417b09d770a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:27.230516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7d14-1f97-4705-912e-c417b09d770a None admin] PATH_INFO: `/v3/users/8b547d40976a4562b640ba98db3c5fef` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:27.232472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc7d14-1f97-4705-912e-c417b09d770a None admin] RBAC: Authorizing `identity:get_user(user_id=8b547d40976a4562b640ba98db3c5fef)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:27.234800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc7d14-1f97-4705-912e-c417b09d770a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:27.236700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 156/306] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:27 2022] GET /identity/v3/users/8b547d40976a4562b640ba98db3c5fef => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:27.237664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7d14-1f97-4705-912e-c417b09d770a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:27.314095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b5b0d-91b7-435f-a594-bb4479efad03 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:27.321289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:27.350181 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74858e41-5c83-43e9-9b89-c2aa3b683e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:27.350785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858e41-5c83-43e9-9b89-c2aa3b683e60 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:27.351063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858e41-5c83-43e9-9b89-c2aa3b683e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:27.351337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858e41-5c83-43e9-9b89-c2aa3b683e60 None admin] PATH_INFO: `/v3/groups` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:27.351962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74858e41-5c83-43e9-9b89-c2aa3b683e60 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:27.353388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74858e41-5c83-43e9-9b89-c2aa3b683e60 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:27.364880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7d14-1f97-4705-912e-c417b09d770a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:27.377649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 151/307] 10.222.0.50 () {60 vars in 1134 bytes} [Mon Sep 19 11:58:27 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:27.377649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74858e41-5c83-43e9-9b89-c2aa3b683e60 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:27.408733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed233b-04c2-47e0-a4e3-c91d63ad900e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:27.409443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed233b-04c2-47e0-a4e3-c91d63ad900e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:27.409819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed233b-04c2-47e0-a4e3-c91d63ad900e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:27.410227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed233b-04c2-47e0-a4e3-c91d63ad900e None admin] PATH_INFO: `/v3/users/4b324647d8004a88a668d53f72bf6ba0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:27.426118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed233b-04c2-47e0-a4e3-c91d63ad900e None admin] RBAC: Authorizing `identity:get_user(user_id=4b324647d8004a88a668d53f72bf6ba0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:27.427935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed233b-04c2-47e0-a4e3-c91d63ad900e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:27.430099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 157/308] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:27 2022] GET /identity/v3/users/4b324647d8004a88a668d53f72bf6ba0 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:27.436290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed233b-04c2-47e0-a4e3-c91d63ad900e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:27.455539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:27.526007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74858e41-5c83-43e9-9b89-c2aa3b683e60 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:27.566788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f91e5c-fe29-44bb-a382-0c76c745fc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:27.567488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f91e5c-fe29-44bb-a382-0c76c745fc0d None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:27.567768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f91e5c-fe29-44bb-a382-0c76c745fc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:27.568060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f91e5c-fe29-44bb-a382-0c76c745fc0d None admin] PATH_INFO: `/v3/system/users/8b547d40976a4562b640ba98db3c5fef/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:27.568552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed233b-04c2-47e0-a4e3-c91d63ad900e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:27.569544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f91e5c-fe29-44bb-a382-0c76c745fc0d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8b547d40976a4562b640ba98db3c5fef, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:27.571229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f91e5c-fe29-44bb-a382-0c76c745fc0d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:27.580526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 152/309] 10.222.0.50 () {58 vars in 1334 bytes} [Mon Sep 19 11:58:27 2022] PUT /identity/v3/system/users/8b547d40976a4562b640ba98db3c5fef/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:27.617845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e41bf4-e53a-45c3-8537-ca85526b3d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:27.618505 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e41bf4-e53a-45c3-8537-ca85526b3d9c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:27.618796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e41bf4-e53a-45c3-8537-ca85526b3d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:27.619331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e41bf4-e53a-45c3-8537-ca85526b3d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:27.619899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e41bf4-e53a-45c3-8537-ca85526b3d9c None admin] RBAC: Adding query filter params (role.id=882e144ddabb436ba7e9c2130cf9cb49, user.id=4b324647d8004a88a668d53f72bf6ba0, scope.system=all) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:27.620215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e41bf4-e53a-45c3-8537-ca85526b3d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:27.622606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e41bf4-e53a-45c3-8537-ca85526b3d9c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:27.629588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 158/310] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Sep 19 11:58:27 2022] GET /identity/v3/role_assignments?user.id=4b324647d8004a88a668d53f72bf6ba0&scope.system=all&role.id=882e144ddabb436ba7e9c2130cf9cb49 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:28.453997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3477-0ed1-49d0-aa98-2b36a943b40c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:28.454376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3477-0ed1-49d0-aa98-2b36a943b40c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:28.454571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3477-0ed1-49d0-aa98-2b36a943b40c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:28.456029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 153/311] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:28.461700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a289-92e7-4034-8b6e-ededc73ff49c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:28.462200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a289-92e7-4034-8b6e-ededc73ff49c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:28.462716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a289-92e7-4034-8b6e-ededc73ff49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:28.482593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9aa1a289-92e7-4034-8b6e-ededc73ff49c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:28.484097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9aa1a289-92e7-4034-8b6e-ededc73ff49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:28.567240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 159/312] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:28.877145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b3477-0ed1-49d0-aa98-2b36a943b40c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:28.915501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:29.001300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b3477-0ed1-49d0-aa98-2b36a943b40c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:29.038002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eae762-6ab1-4fc1-925c-c91c203f1b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:29.038689 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae762-6ab1-4fc1-925c-c91c203f1b5a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:29.039143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae762-6ab1-4fc1-925c-c91c203f1b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:29.039629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae762-6ab1-4fc1-925c-c91c203f1b5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:29.051483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eae762-6ab1-4fc1-925c-c91c203f1b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e6eae762-6ab1-4fc1-925c-c91c203f1b5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:29.060177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:29.061108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:29.061917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:29.062519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 154/313] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:29.069643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a289-92e7-4034-8b6e-ededc73ff49c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:29.082567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:29.188323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a289-92e7-4034-8b6e-ededc73ff49c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:29.223950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd045cb-c6e4-4fe9-ab11-b3ced896283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:29.224566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd045cb-c6e4-4fe9-ab11-b3ced896283c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:29.224845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd045cb-c6e4-4fe9-ab11-b3ced896283c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:29.225120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd045cb-c6e4-4fe9-ab11-b3ced896283c None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:29.225825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd045cb-c6e4-4fe9-ab11-b3ced896283c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:29.226125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd045cb-c6e4-4fe9-ab11-b3ced896283c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:29.227547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd045cb-c6e4-4fe9-ab11-b3ced896283c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:29.237086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 160/314] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:29.245101 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eae762-6ab1-4fc1-925c-c91c203f1b5a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:29.360875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:29.375775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eae762-6ab1-4fc1-925c-c91c203f1b5a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:29.429790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edf860-86ca-4c77-a2cb-08baea6f5d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:29.430908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edf860-86ca-4c77-a2cb-08baea6f5d38 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:29.431537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edf860-86ca-4c77-a2cb-08baea6f5d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:29.432053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edf860-86ca-4c77-a2cb-08baea6f5d38 None admin] PATH_INFO: `/v3/users/a5bea5eac9d84912a7aa8da16833ab6f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:29.433720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edf860-86ca-4c77-a2cb-08baea6f5d38 None admin] RBAC: Authorizing `identity:get_user(user_id=a5bea5eac9d84912a7aa8da16833ab6f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:29.436149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edf860-86ca-4c77-a2cb-08baea6f5d38 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:29.438117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 155/315] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:29 2022] GET /identity/v3/users/a5bea5eac9d84912a7aa8da16833ab6f => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:29.443324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd045cb-c6e4-4fe9-ab11-b3ced896283c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:29.530151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:29.554314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd045cb-c6e4-4fe9-ab11-b3ced896283c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:29.590070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78120d4-e6cc-41c1-bc74-68e6fec5dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:29.590977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78120d4-e6cc-41c1-bc74-68e6fec5dea0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:29.591632 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78120d4-e6cc-41c1-bc74-68e6fec5dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:29.591912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78120d4-e6cc-41c1-bc74-68e6fec5dea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:29.672181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78120d4-e6cc-41c1-bc74-68e6fec5dea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:29.673663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78120d4-e6cc-41c1-bc74-68e6fec5dea0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:29.749147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:29.782986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 161/316] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:29.788654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edf860-86ca-4c77-a2cb-08baea6f5d38 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:29.821662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3b3b-65be-4059-8ea5-0be4347a1b56 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:29.821983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3b3b-65be-4059-8ea5-0be4347a1b56 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:29.822229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3b3b-65be-4059-8ea5-0be4347a1b56 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:29.823927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 162/317] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:29.830176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5edcb7-45a8-4f75-b403-162db783821d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:29.830489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5edcb7-45a8-4f75-b403-162db783821d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:29.830738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5edcb7-45a8-4f75-b403-162db783821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:29.849942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6e5edcb7-45a8-4f75-b403-162db783821d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:29.851147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6e5edcb7-45a8-4f75-b403-162db783821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:29.916583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edf860-86ca-4c77-a2cb-08baea6f5d38 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:29.934165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 163/318] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:29.937400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e4ee0-b69e-4b1c-915f-10bd13f804b8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:29.937711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e4ee0-b69e-4b1c-915f-10bd13f804b8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:29.938016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e4ee0-b69e-4b1c-915f-10bd13f804b8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:29.939375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 164/319] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:29.945463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f7097-7dfa-47b5-bb54-c9e6cb9d90eb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:29.946108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f7097-7dfa-47b5-bb54-c9e6cb9d90eb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:29.946578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f7097-7dfa-47b5-bb54-c9e6cb9d90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:29.960567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aebe67-faf6-40cd-afa2-b9c70551e94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:29.961488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aebe67-faf6-40cd-afa2-b9c70551e94d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:29.961595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aebe67-faf6-40cd-afa2-b9c70551e94d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:29.961840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aebe67-faf6-40cd-afa2-b9c70551e94d None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:29.963130 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aebe67-faf6-40cd-afa2-b9c70551e94d None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:29.964703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aebe67-faf6-40cd-afa2-b9c70551e94d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:29.971827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 156/320] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:29 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:29.972006 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4d9f7097-7dfa-47b5-bb54-c9e6cb9d90eb None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:29.972251 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4d9f7097-7dfa-47b5-bb54-c9e6cb9d90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:29.975034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aebe67-faf6-40cd-afa2-b9c70551e94d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:30.011884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:30.055747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 165/321] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:30.069667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86147b-8e37-4864-84a8-9eb5640c0384 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:30.070247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86147b-8e37-4864-84a8-9eb5640c0384 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:30.070247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86147b-8e37-4864-84a8-9eb5640c0384 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:30.075648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 166/322] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:30.076966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9acfb1-ddf0-483b-88b2-7fce8d30db2d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:30.077253 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9acfb1-ddf0-483b-88b2-7fce8d30db2d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:30.077534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9acfb1-ddf0-483b-88b2-7fce8d30db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:30.097452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-da9acfb1-ddf0-483b-88b2-7fce8d30db2d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:30.099031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-da9acfb1-ddf0-483b-88b2-7fce8d30db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:30.108423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aebe67-faf6-40cd-afa2-b9c70551e94d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:30.133672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:30.145006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc5644-c701-4060-bf9e-49ffe6391852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:30.145905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc5644-c701-4060-bf9e-49ffe6391852 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:30.146406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc5644-c701-4060-bf9e-49ffe6391852 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:30.146872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc5644-c701-4060-bf9e-49ffe6391852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:30.147793 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc5644-c701-4060-bf9e-49ffe6391852 None admin] RBAC: Adding query filter params (role.id=882e144ddabb436ba7e9c2130cf9cb49, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29, user.id=a5bea5eac9d84912a7aa8da16833ab6f) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:30.148317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc5644-c701-4060-bf9e-49ffe6391852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:30.149954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc5644-c701-4060-bf9e-49ffe6391852 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:30.158608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 157/323] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:29 2022] GET /identity/v3/role_assignments?user.id=a5bea5eac9d84912a7aa8da16833ab6f&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=882e144ddabb436ba7e9c2130cf9cb49 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:30.182138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 167/324] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:30.205222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc5644-c701-4060-bf9e-49ffe6391852 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:30.316675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:30.329221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc5644-c701-4060-bf9e-49ffe6391852 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:30.345042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9acfb1-ddf0-483b-88b2-7fce8d30db2d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:30.372682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1723-fdaf-4e40-9397-74f8c10808e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:30.373396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1723-fdaf-4e40-9397-74f8c10808e6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:30.373699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1723-fdaf-4e40-9397-74f8c10808e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:30.373974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1723-fdaf-4e40-9397-74f8c10808e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:30.375099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a1723-fdaf-4e40-9397-74f8c10808e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:30.377075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a1723-fdaf-4e40-9397-74f8c10808e6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:30.378442 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 158/325] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:30.383888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1723-fdaf-4e40-9397-74f8c10808e6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:30.481463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9acfb1-ddf0-483b-88b2-7fce8d30db2d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:30.504248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1723-fdaf-4e40-9397-74f8c10808e6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:30.516360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d9e97-b1d6-4879-a508-1463e680683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:30.517079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d9e97-b1d6-4879-a508-1463e680683c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:30.517273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d9e97-b1d6-4879-a508-1463e680683c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:30.517549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d9e97-b1d6-4879-a508-1463e680683c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:30.527583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d9e97-b1d6-4879-a508-1463e680683c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cb2d9e97-b1d6-4879-a508-1463e680683c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:30.533065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:30.534107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 168/326] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:30.534959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d9e97-b1d6-4879-a508-1463e680683c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:30.539752 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf6a7b-d523-4a85-869b-69a97bdda585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:30.540362 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf6a7b-d523-4a85-869b-69a97bdda585 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:30.540648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf6a7b-d523-4a85-869b-69a97bdda585 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:30.540921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf6a7b-d523-4a85-869b-69a97bdda585 None admin] PATH_INFO: `/v3/groups` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:30.541547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf6a7b-d523-4a85-869b-69a97bdda585 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:30.543023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf6a7b-d523-4a85-869b-69a97bdda585 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:30.558354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 159/327] 10.222.0.50 () {60 vars in 1134 bytes} [Mon Sep 19 11:58:30 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:30.558354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf6a7b-d523-4a85-869b-69a97bdda585 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:30.569988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:30.585963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:30.662369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d9e97-b1d6-4879-a508-1463e680683c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:30.690081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf6a7b-d523-4a85-869b-69a97bdda585 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:30.705399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2ae72-adfe-4190-a3b7-9df922276bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:30.706350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ae72-adfe-4190-a3b7-9df922276bda None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:30.706794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ae72-adfe-4190-a3b7-9df922276bda None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:30.707066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2ae72-adfe-4190-a3b7-9df922276bda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:30.721221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2ae72-adfe-4190-a3b7-9df922276bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-29d2ae72-adfe-4190-a3b7-9df922276bda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:30.726572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:30.727446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:30.728214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 169/328] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:30.733835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a46259-8929-40cb-8bd5-ac465b1a34c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:30.734399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a46259-8929-40cb-8bd5-ac465b1a34c2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:30.734679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a46259-8929-40cb-8bd5-ac465b1a34c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:30.734948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a46259-8929-40cb-8bd5-ac465b1a34c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:30.735546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2ae72-adfe-4190-a3b7-9df922276bda None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:30.735674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a46259-8929-40cb-8bd5-ac465b1a34c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:30.735907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a46259-8929-40cb-8bd5-ac465b1a34c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:30.737292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a46259-8929-40cb-8bd5-ac465b1a34c2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:30.751132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 160/329] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:30.752916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a46259-8929-40cb-8bd5-ac465b1a34c2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:30.840654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:30.851863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:30.865560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2ae72-adfe-4190-a3b7-9df922276bda None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:30.877278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a46259-8929-40cb-8bd5-ac465b1a34c2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:30.905504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146abbbc-69ce-4ca5-85fb-59f2254117ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:30.906373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146abbbc-69ce-4ca5-85fb-59f2254117ed None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:30.906835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146abbbc-69ce-4ca5-85fb-59f2254117ed None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:30.907109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146abbbc-69ce-4ca5-85fb-59f2254117ed None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:30.907781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146abbbc-69ce-4ca5-85fb-59f2254117ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:30.908111 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146abbbc-69ce-4ca5-85fb-59f2254117ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:30.909445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146abbbc-69ce-4ca5-85fb-59f2254117ed None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:30.916974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c475a3-448b-49f5-9475-e7e421d6a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:30.918365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c475a3-448b-49f5-9475-e7e421d6a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:30.919324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c475a3-448b-49f5-9475-e7e421d6a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:30.919674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c475a3-448b-49f5-9475-e7e421d6a1a7 None admin] PATH_INFO: `/v3/users/8b547d40976a4562b640ba98db3c5fef` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:30.920862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c475a3-448b-49f5-9475-e7e421d6a1a7 None admin] RBAC: Authorizing `identity:get_user(user_id=8b547d40976a4562b640ba98db3c5fef)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:30.922272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 170/330] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:30.922387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c475a3-448b-49f5-9475-e7e421d6a1a7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:30.923936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 161/331] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:30 2022] GET /identity/v3/users/8b547d40976a4562b640ba98db3c5fef => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:30.929994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146abbbc-69ce-4ca5-85fb-59f2254117ed None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:30.930612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c475a3-448b-49f5-9475-e7e421d6a1a7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:31.055943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c475a3-448b-49f5-9475-e7e421d6a1a7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:31.060776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146abbbc-69ce-4ca5-85fb-59f2254117ed None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:31.092206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6eb6e-98d3-4745-8835-99ef82cae7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:31.093097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6eb6e-98d3-4745-8835-99ef82cae7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:31.093654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6eb6e-98d3-4745-8835-99ef82cae7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:31.094151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6eb6e-98d3-4745-8835-99ef82cae7e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:31.095345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6eb6e-98d3-4745-8835-99ef82cae7e2 None admin] RBAC: Adding query filter params (role.id=b320236412e649d9ab1e6787ef8a6870, user.id=8b547d40976a4562b640ba98db3c5fef, scope.system=all) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:31.095951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6eb6e-98d3-4745-8835-99ef82cae7e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:31.097635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c60ae9-be93-411c-8e26-7c1ebe2675f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:31.098524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c60ae9-be93-411c-8e26-7c1ebe2675f0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:31.098802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c60ae9-be93-411c-8e26-7c1ebe2675f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:31.099073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c60ae9-be93-411c-8e26-7c1ebe2675f0 None admin] PATH_INFO: `/v3/users/4b324647d8004a88a668d53f72bf6ba0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:31.099294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6eb6e-98d3-4745-8835-99ef82cae7e2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:31.100199 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c60ae9-be93-411c-8e26-7c1ebe2675f0 None admin] RBAC: Authorizing `identity:get_user(user_id=4b324647d8004a88a668d53f72bf6ba0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:31.101760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c60ae9-be93-411c-8e26-7c1ebe2675f0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:31.103851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 171/332] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:30 2022] GET /identity/v3/users/4b324647d8004a88a668d53f72bf6ba0 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:31.109513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c60ae9-be93-411c-8e26-7c1ebe2675f0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:31.114636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 162/333] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Sep 19 11:58:30 2022] GET /identity/v3/role_assignments?user.id=8b547d40976a4562b640ba98db3c5fef&scope.system=all&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:31.131075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:31.234201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c60ae9-be93-411c-8e26-7c1ebe2675f0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:31.272179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd7c46-6d4b-4d0d-b8b2-ea2d27ad7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:31.273269 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd7c46-6d4b-4d0d-b8b2-ea2d27ad7578 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:31.273749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd7c46-6d4b-4d0d-b8b2-ea2d27ad7578 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:31.274203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd7c46-6d4b-4d0d-b8b2-ea2d27ad7578 None admin] PATH_INFO: `/v3/system/users/4b324647d8004a88a668d53f72bf6ba0/roles/882e144ddabb436ba7e9c2130cf9cb49` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:31.275878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd7c46-6d4b-4d0d-b8b2-ea2d27ad7578 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4b324647d8004a88a668d53f72bf6ba0, role_id=882e144ddabb436ba7e9c2130cf9cb49)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:31.277467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd7c46-6d4b-4d0d-b8b2-ea2d27ad7578 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:31.291318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 172/334] 10.222.0.50 () {58 vars in 1334 bytes} [Mon Sep 19 11:58:31 2022] PUT /identity/v3/system/users/4b324647d8004a88a668d53f72bf6ba0/roles/882e144ddabb436ba7e9c2130cf9cb49 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:58:32.968809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d6fc7-62ee-4d9c-9338-b9cb7af5cdbb None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:32.969756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d6fc7-62ee-4d9c-9338-b9cb7af5cdbb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:32.970257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d6fc7-62ee-4d9c-9338-b9cb7af5cdbb None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:32.972087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 163/335] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:32.977476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18121c-b693-43e0-a251-486a499b5e89 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:32.978327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18121c-b693-43e0-a251-486a499b5e89 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:32.978797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18121c-b693-43e0-a251-486a499b5e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.002076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bf18121c-b693-43e0-a251-486a499b5e89 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:33.003585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bf18121c-b693-43e0-a251-486a499b5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:33.081460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 173/336] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:33.455508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed640298-f79b-45d2-9798-c6ef189c67a7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.456182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed640298-f79b-45d2-9798-c6ef189c67a7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.456680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed640298-f79b-45d2-9798-c6ef189c67a7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.458490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 164/337] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:33.467840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602fdc4-d1eb-4cbe-b170-1d9d5ec0e7cc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.468392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602fdc4-d1eb-4cbe-b170-1d9d5ec0e7cc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.468862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602fdc4-d1eb-4cbe-b170-1d9d5ec0e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.476646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:33.492704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5602fdc4-d1eb-4cbe-b170-1d9d5ec0e7cc None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:33.493904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5602fdc4-d1eb-4cbe-b170-1d9d5ec0e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:33.530370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed640298-f79b-45d2-9798-c6ef189c67a7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:33.539657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:33.639613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 174/338] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:33.708777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed640298-f79b-45d2-9798-c6ef189c67a7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:33.748436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0f1c5-1fb3-4d79-85ad-7f54453ff321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:33.749104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0f1c5-1fb3-4d79-85ad-7f54453ff321 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.749352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0f1c5-1fb3-4d79-85ad-7f54453ff321 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.749655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0f1c5-1fb3-4d79-85ad-7f54453ff321 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.764692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0f1c5-1fb3-4d79-85ad-7f54453ff321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-88f0f1c5-1fb3-4d79-85ad-7f54453ff321 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:33.770165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:33.771043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:33.772220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 165/339] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:33.779327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602fdc4-d1eb-4cbe-b170-1d9d5ec0e7cc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:33.891825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602fdc4-d1eb-4cbe-b170-1d9d5ec0e7cc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:33.932938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34578a99-ea66-4744-8c93-d0f1704be29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:33.933554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34578a99-ea66-4744-8c93-d0f1704be29a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.933855 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34578a99-ea66-4744-8c93-d0f1704be29a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.934159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34578a99-ea66-4744-8c93-d0f1704be29a None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.935322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34578a99-ea66-4744-8c93-d0f1704be29a None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:33.935623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34578a99-ea66-4744-8c93-d0f1704be29a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:33.936994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34578a99-ea66-4744-8c93-d0f1704be29a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:33.942504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:33.950855 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 175/340] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:33.957960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0f1c5-1fb3-4d79-85ad-7f54453ff321 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:34.007389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cdc24-3cf3-45c8-a02a-80bd2b95ecfd None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.007871 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cdc24-3cf3-45c8-a02a-80bd2b95ecfd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.007871 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cdc24-3cf3-45c8-a02a-80bd2b95ecfd None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.009297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 176/341] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:34.015099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac112d-2571-471f-8fc5-be72100669b6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.015380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac112d-2571-471f-8fc5-be72100669b6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.015651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac112d-2571-471f-8fc5-be72100669b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.046833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9aac112d-2571-471f-8fc5-be72100669b6 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:34.048026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9aac112d-2571-471f-8fc5-be72100669b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:34.081790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:34.138637 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0f1c5-1fb3-4d79-85ad-7f54453ff321 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:34.180867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068b774-83c2-4633-875f-03397a1c863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:34.181484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b774-83c2-4633-875f-03397a1c863e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.181786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b774-83c2-4633-875f-03397a1c863e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.182057 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b774-83c2-4633-875f-03397a1c863e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.203399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 177/342] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:34.204699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac112d-2571-471f-8fc5-be72100669b6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:34.264810 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068b774-83c2-4633-875f-03397a1c863e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:34.267086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068b774-83c2-4633-875f-03397a1c863e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:34.341833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:34.375554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac112d-2571-471f-8fc5-be72100669b6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:34.406356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:34.409398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 166/343] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:34.414154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068b774-83c2-4633-875f-03397a1c863e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:34.415049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808835-c1e5-4f44-9ac2-f8f2632382d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:34.415695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808835-c1e5-4f44-9ac2-f8f2632382d0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.415968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808835-c1e5-4f44-9ac2-f8f2632382d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.416421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808835-c1e5-4f44-9ac2-f8f2632382d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.430052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b808835-c1e5-4f44-9ac2-f8f2632382d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6b808835-c1e5-4f44-9ac2-f8f2632382d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:34.435250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:34.437325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:34.439021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 178/344] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:34.445059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808835-c1e5-4f44-9ac2-f8f2632382d0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:34.609257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068b774-83c2-4633-875f-03397a1c863e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:34.613827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808835-c1e5-4f44-9ac2-f8f2632382d0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:34.653863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5dd32-bd81-4aa2-9255-0adb889f8830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:34.654624 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5dd32-bd81-4aa2-9255-0adb889f8830 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.654920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5dd32-bd81-4aa2-9255-0adb889f8830 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.655197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5dd32-bd81-4aa2-9255-0adb889f8830 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.656372 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5dd32-bd81-4aa2-9255-0adb889f8830 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:34.660201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5dd32-bd81-4aa2-9255-0adb889f8830 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:34.664979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 167/345] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:34 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:34.672324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5dd32-bd81-4aa2-9255-0adb889f8830 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:34.716336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05532a-7f38-4f77-a2bd-b27824d13399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:34.717046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05532a-7f38-4f77-a2bd-b27824d13399 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.717330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05532a-7f38-4f77-a2bd-b27824d13399 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.717903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05532a-7f38-4f77-a2bd-b27824d13399 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.718311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05532a-7f38-4f77-a2bd-b27824d13399 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:34.718614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05532a-7f38-4f77-a2bd-b27824d13399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:34.719982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05532a-7f38-4f77-a2bd-b27824d13399 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:34.729470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 179/346] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:34.730051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05532a-7f38-4f77-a2bd-b27824d13399 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:34.733567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:34.816134 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:34.844540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5dd32-bd81-4aa2-9255-0adb889f8830 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:34.876339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05532a-7f38-4f77-a2bd-b27824d13399 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:34.882614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397541d8-7102-474a-8ddb-477d096b0b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:34.883490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397541d8-7102-474a-8ddb-477d096b0b06 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.883863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397541d8-7102-474a-8ddb-477d096b0b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.884231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397541d8-7102-474a-8ddb-477d096b0b06 None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.890680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397541d8-7102-474a-8ddb-477d096b0b06 None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:34.892218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397541d8-7102-474a-8ddb-477d096b0b06 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:34.894358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 168/347] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:34 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:34.895263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397541d8-7102-474a-8ddb-477d096b0b06 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:34.923814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9924b2-a5b2-4468-b0fe-4c96f4458deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:34.925128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9924b2-a5b2-4468-b0fe-4c96f4458deb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.926016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9924b2-a5b2-4468-b0fe-4c96f4458deb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.926447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9924b2-a5b2-4468-b0fe-4c96f4458deb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.939700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9924b2-a5b2-4468-b0fe-4c96f4458deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8e9924b2-a5b2-4468-b0fe-4c96f4458deb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:34.945896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:34.946902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:58:34.947714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:34.951288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 180/348] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:34.953504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f00d4-e752-4368-b3f3-a811212132b8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.958227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f00d4-e752-4368-b3f3-a811212132b8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.958729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f00d4-e752-4368-b3f3-a811212132b8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.960304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 181/349] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:34.961500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f00d4-e752-4368-b3f3-a811212132b8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:35.009254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:35.014122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397541d8-7102-474a-8ddb-477d096b0b06 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:35.049828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a66ac-0c47-406c-a2c2-d6940c1b5196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:35.050514 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a66ac-0c47-406c-a2c2-d6940c1b5196 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.050861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a66ac-0c47-406c-a2c2-d6940c1b5196 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.051201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a66ac-0c47-406c-a2c2-d6940c1b5196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.083425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f00d4-e752-4368-b3f3-a811212132b8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:35.093938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:35.123060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b7783-2ad3-463b-a14f-d6214f4b2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:35.124018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b7783-2ad3-463b-a14f-d6214f4b2b2b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.124476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b7783-2ad3-463b-a14f-d6214f4b2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.124950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b7783-2ad3-463b-a14f-d6214f4b2b2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.125657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a66ac-0c47-406c-a2c2-d6940c1b5196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:35.126497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b7783-2ad3-463b-a14f-d6214f4b2b2b None admin] RBAC: Adding query filter params (group.id=c8ecb613aa2e4f91a57228048bb2e9d2, role.id=b320236412e649d9ab1e6787ef8a6870, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:35.127028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b7783-2ad3-463b-a14f-d6214f4b2b2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:35.127339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a66ac-0c47-406c-a2c2-d6940c1b5196 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:35.128868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b7783-2ad3-463b-a14f-d6214f4b2b2b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:35.135364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 182/350] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 19 11:58:34 2022] GET /identity/v3/role_assignments?group.id=c8ecb613aa2e4f91a57228048bb2e9d2&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:35.136458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b7783-2ad3-463b-a14f-d6214f4b2b2b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:35.240741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:35.241003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 169/351] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:35.242858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74be36-dea9-4aa5-bc39-70e0e351cb6a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.243207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74be36-dea9-4aa5-bc39-70e0e351cb6a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.243557 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74be36-dea9-4aa5-bc39-70e0e351cb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.250429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b7783-2ad3-463b-a14f-d6214f4b2b2b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:35.264919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8b74be36-dea9-4aa5-bc39-70e0e351cb6a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:35.266424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8b74be36-dea9-4aa5-bc39-70e0e351cb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:35.291477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738211-9280-48f1-9467-bdefffb9844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:35.292432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738211-9280-48f1-9467-bdefffb9844d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.292915 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738211-9280-48f1-9467-bdefffb9844d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.293396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738211-9280-48f1-9467-bdefffb9844d None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.295069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738211-9280-48f1-9467-bdefffb9844d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:35.295569 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738211-9280-48f1-9467-bdefffb9844d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:35.297165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738211-9280-48f1-9467-bdefffb9844d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:35.307528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 183/352] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:35.308705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738211-9280-48f1-9467-bdefffb9844d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:35.344736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 170/353] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:35.345811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74be36-dea9-4aa5-bc39-70e0e351cb6a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:35.354636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:35.431066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738211-9280-48f1-9467-bdefffb9844d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:35.478107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ef89-bf31-4b83-9deb-6d75b6a14fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:35.478947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ef89-bf31-4b83-9deb-6d75b6a14fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.479325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ef89-bf31-4b83-9deb-6d75b6a14fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.481901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ef89-bf31-4b83-9deb-6d75b6a14fb2 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.483216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ef89-bf31-4b83-9deb-6d75b6a14fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:35.484770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ef89-bf31-4b83-9deb-6d75b6a14fb2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:35.488927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 184/354] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:35 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:35.493584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ef89-bf31-4b83-9deb-6d75b6a14fb2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:35.563962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74be36-dea9-4aa5-bc39-70e0e351cb6a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:35.614680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ef89-bf31-4b83-9deb-6d75b6a14fb2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:35.617739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:35.651524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45a77f-a553-41c1-9cee-6287b64dd024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:35.652369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a77f-a553-41c1-9cee-6287b64dd024 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.652746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a77f-a553-41c1-9cee-6287b64dd024 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.653645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a77f-a553-41c1-9cee-6287b64dd024 None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.655103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45a77f-a553-41c1-9cee-6287b64dd024 None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:35.656715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45a77f-a553-41c1-9cee-6287b64dd024 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:35.658993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 185/355] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:35 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:35.662885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd08f5-1f96-4d62-aa2f-63fafdc449df None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.662885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd08f5-1f96-4d62-aa2f-63fafdc449df None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.662885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd08f5-1f96-4d62-aa2f-63fafdc449df None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.662885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 186/356] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:35.669510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:35.674575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682d695-c2aa-42e5-a889-ed87d02a3bb8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.675045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682d695-c2aa-42e5-a889-ed87d02a3bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.675519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682d695-c2aa-42e5-a889-ed87d02a3bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.695940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2682d695-c2aa-42e5-a889-ed87d02a3bb8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:35.698060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2682d695-c2aa-42e5-a889-ed87d02a3bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:35.726356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc679-67fa-4493-ab33-c644e4b74fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:35.727013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc679-67fa-4493-ab33-c644e4b74fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.727297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc679-67fa-4493-ab33-c644e4b74fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.727593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc679-67fa-4493-ab33-c644e4b74fe5 None admin] PATH_INFO: `/v3/users/4b324647d8004a88a668d53f72bf6ba0` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.728832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dc679-67fa-4493-ab33-c644e4b74fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=4b324647d8004a88a668d53f72bf6ba0)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:35.730240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dc679-67fa-4493-ab33-c644e4b74fe5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:35.732870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 171/357] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 11:58:35 2022] GET /identity/v3/users/4b324647d8004a88a668d53f72bf6ba0 => generated 293 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:35.733538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc679-67fa-4493-ab33-c644e4b74fe5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:35.782234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 187/358] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:35.783425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682d695-c2aa-42e5-a889-ed87d02a3bb8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:35.917132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc679-67fa-4493-ab33-c644e4b74fe5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:35.920929 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:35.924417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682d695-c2aa-42e5-a889-ed87d02a3bb8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:35.965785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7d2ce-e11c-450c-b455-5eaf3b7d173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:35.968551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d2ce-e11c-450c-b455-5eaf3b7d173c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.969084 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d2ce-e11c-450c-b455-5eaf3b7d173c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.969506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d2ce-e11c-450c-b455-5eaf3b7d173c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.970583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7d2ce-e11c-450c-b455-5eaf3b7d173c None admin] RBAC: Adding query filter params (role.id=882e144ddabb436ba7e9c2130cf9cb49, user.id=4b324647d8004a88a668d53f72bf6ba0, scope.system=all) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:35.971052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7d2ce-e11c-450c-b455-5eaf3b7d173c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:35.971163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc708b6c-771b-43d8-ade1-e8473c35c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:35.971776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc708b6c-771b-43d8-ade1-e8473c35c809 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.972049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc708b6c-771b-43d8-ade1-e8473c35c809 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.972317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc708b6c-771b-43d8-ade1-e8473c35c809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:35.973044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc708b6c-771b-43d8-ade1-e8473c35c809 None admin] RBAC: Adding query filter params (group.id=c8ecb613aa2e4f91a57228048bb2e9d2, role.id=c59031d5db354a478ab7a9ac0000e098, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:35.973584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7d2ce-e11c-450c-b455-5eaf3b7d173c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:35.973733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc708b6c-771b-43d8-ade1-e8473c35c809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:35.975040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc708b6c-771b-43d8-ade1-e8473c35c809 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:35.985789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 172/359] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 19 11:58:35 2022] GET /identity/v3/role_assignments?group.id=c8ecb613aa2e4f91a57228048bb2e9d2&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=c59031d5db354a478ab7a9ac0000e098 => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:35.986958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc708b6c-771b-43d8-ade1-e8473c35c809 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:35.994288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 188/360] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Sep 19 11:58:35 2022] GET /identity/v3/role_assignments?user.id=4b324647d8004a88a668d53f72bf6ba0&scope.system=all&role.id=882e144ddabb436ba7e9c2130cf9cb49 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:35.995914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa566d33-9ec7-4a8b-90a3-411e697dd96f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:35.997809 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa566d33-9ec7-4a8b-90a3-411e697dd96f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:35.998256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa566d33-9ec7-4a8b-90a3-411e697dd96f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.002242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 189/361] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:36.006109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08d249-4179-4927-8a1f-4c9001192712 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.006653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08d249-4179-4927-8a1f-4c9001192712 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.007079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08d249-4179-4927-8a1f-4c9001192712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.034438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-af08d249-4179-4927-8a1f-4c9001192712 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:36.035952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-af08d249-4179-4927-8a1f-4c9001192712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:36.172458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:36.173113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 190/362] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:36.174382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08d249-4179-4927-8a1f-4c9001192712 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.283280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc708b6c-771b-43d8-ade1-e8473c35c809 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.314911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:36.332339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08d249-4179-4927-8a1f-4c9001192712 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.359359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382f11-f796-4383-9080-ef34bb2ea199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.360378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382f11-f796-4383-9080-ef34bb2ea199 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.360807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382f11-f796-4383-9080-ef34bb2ea199 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.361224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382f11-f796-4383-9080-ef34bb2ea199 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.380182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d2e9-01f1-4d95-a690-d73bf0b0fd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.380833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d2e9-01f1-4d95-a690-d73bf0b0fd74 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.381110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d2e9-01f1-4d95-a690-d73bf0b0fd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.381377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d2e9-01f1-4d95-a690-d73bf0b0fd74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.389974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382f11-f796-4383-9080-ef34bb2ea199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1b382f11-f796-4383-9080-ef34bb2ea199 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:36.398970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:36.399868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:36.400644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 173/363] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:36.408127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0d2e9-01f1-4d95-a690-d73bf0b0fd74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:36.409118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382f11-f796-4383-9080-ef34bb2ea199 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-15b0d2e9-01f1-4d95-a690-d73bf0b0fd74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:36.413088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:36.413985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:36.414774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 191/364] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:36.420597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d2e9-01f1-4d95-a690-d73bf0b0fd74 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.525080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382f11-f796-4383-9080-ef34bb2ea199 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.546910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:36.555460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d2e9-01f1-4d95-a690-d73bf0b0fd74 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.577819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817310-282b-43f2-af4e-ac4da9dfc627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.578756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817310-282b-43f2-af4e-ac4da9dfc627 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.579175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817310-282b-43f2-af4e-ac4da9dfc627 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.579585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817310-282b-43f2-af4e-ac4da9dfc627 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.580419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89817310-282b-43f2-af4e-ac4da9dfc627 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:36.580860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89817310-282b-43f2-af4e-ac4da9dfc627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:36.582446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89817310-282b-43f2-af4e-ac4da9dfc627 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:36.594191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 174/365] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:36.602614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817310-282b-43f2-af4e-ac4da9dfc627 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.616053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531a984-354c-468a-8222-abf8c4964dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.616875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531a984-354c-468a-8222-abf8c4964dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.617309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531a984-354c-468a-8222-abf8c4964dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.617771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531a984-354c-468a-8222-abf8c4964dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.618586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531a984-354c-468a-8222-abf8c4964dc2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:36.619026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531a984-354c-468a-8222-abf8c4964dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:36.620537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531a984-354c-468a-8222-abf8c4964dc2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:36.639994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 192/366] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:36.643272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531a984-354c-468a-8222-abf8c4964dc2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.672501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:36.758539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817310-282b-43f2-af4e-ac4da9dfc627 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.772845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531a984-354c-468a-8222-abf8c4964dc2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.798531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bcc0a-fc62-4d5d-9bf3-1ed7acf54c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.799357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bcc0a-fc62-4d5d-9bf3-1ed7acf54c53 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.799627 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bcc0a-fc62-4d5d-9bf3-1ed7acf54c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.799902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bcc0a-fc62-4d5d-9bf3-1ed7acf54c53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.818332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0793e-f24b-497f-b6aa-8a7765194c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.819000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0793e-f24b-497f-b6aa-8a7765194c70 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.819286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0793e-f24b-497f-b6aa-8a7765194c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.819564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0793e-f24b-497f-b6aa-8a7765194c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.861236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:36.881568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bcc0a-fc62-4d5d-9bf3-1ed7acf54c53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:36.883222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bcc0a-fc62-4d5d-9bf3-1ed7acf54c53 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:36.902847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0793e-f24b-497f-b6aa-8a7765194c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:36.904597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0793e-f24b-497f-b6aa-8a7765194c70 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:36.917608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:36.993730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 175/367] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:36.994701 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bcc0a-fc62-4d5d-9bf3-1ed7acf54c53 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.019425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 193/368] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:37.020287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0793e-f24b-497f-b6aa-8a7765194c70 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.089920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:37.104229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bcc0a-fc62-4d5d-9bf3-1ed7acf54c53 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.128914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0793e-f24b-497f-b6aa-8a7765194c70 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.140728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:37.146327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d0e95-44c1-48cd-b7ca-c7968837cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.147741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0e95-44c1-48cd-b7ca-c7968837cd3f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.148532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0e95-44c1-48cd-b7ca-c7968837cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.148944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0e95-44c1-48cd-b7ca-c7968837cd3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.162804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d0e95-44c1-48cd-b7ca-c7968837cd3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:37.167667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab843c-88d5-4989-a666-52a4ad99f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.168304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab843c-88d5-4989-a666-52a4ad99f496 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-852d0e95-44c1-48cd-b7ca-c7968837cd3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:37.168533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:37.169483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:37.170469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:37.171097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab843c-88d5-4989-a666-52a4ad99f496 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.171097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab843c-88d5-4989-a666-52a4ad99f496 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.171097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab843c-88d5-4989-a666-52a4ad99f496 None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.171581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab843c-88d5-4989-a666-52a4ad99f496 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.172586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 176/369] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:58:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:37.173893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d0e95-44c1-48cd-b7ca-c7968837cd3f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.178549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 194/370] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:37 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:37.179722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab843c-88d5-4989-a666-52a4ad99f496 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.310981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d0e95-44c1-48cd-b7ca-c7968837cd3f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.313955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab843c-88d5-4989-a666-52a4ad99f496 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.355168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640bfeb-a9e8-4266-a728-c905e2247f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.355711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640bfeb-a9e8-4266-a728-c905e2247f4e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.356021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640bfeb-a9e8-4266-a728-c905e2247f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.356288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640bfeb-a9e8-4266-a728-c905e2247f4e None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.356851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7d161-518a-42cb-9610-8c921b5f3fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.356975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640bfeb-a9e8-4266-a728-c905e2247f4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:37.357240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640bfeb-a9e8-4266-a728-c905e2247f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.358006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d161-518a-42cb-9610-8c921b5f3fba None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.358570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d161-518a-42cb-9610-8c921b5f3fba None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.358678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640bfeb-a9e8-4266-a728-c905e2247f4e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.359124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d161-518a-42cb-9610-8c921b5f3fba None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.360734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7d161-518a-42cb-9610-8c921b5f3fba None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.362818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7d161-518a-42cb-9610-8c921b5f3fba None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.366702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 177/371] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:37 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:37.367039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7d161-518a-42cb-9610-8c921b5f3fba None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.369486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 195/372] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:37.374330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640bfeb-a9e8-4266-a728-c905e2247f4e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.381893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:37.432893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:37.508819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7d161-518a-42cb-9610-8c921b5f3fba None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.514043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640bfeb-a9e8-4266-a728-c905e2247f4e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.559841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff260726-9769-4b5a-bd6a-612d9f869e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.560715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff260726-9769-4b5a-bd6a-612d9f869e50 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.561134 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff260726-9769-4b5a-bd6a-612d9f869e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.561613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff260726-9769-4b5a-bd6a-612d9f869e50 None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.563256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff260726-9769-4b5a-bd6a-612d9f869e50 None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.563526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb6248-c67c-473d-9c9d-8c72fba5aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.564416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb6248-c67c-473d-9c9d-8c72fba5aef6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.564675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff260726-9769-4b5a-bd6a-612d9f869e50 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.565107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb6248-c67c-473d-9c9d-8c72fba5aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.565734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb6248-c67c-473d-9c9d-8c72fba5aef6 None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.566617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 196/373] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:37 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:37.567264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb6248-c67c-473d-9c9d-8c72fba5aef6 None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.567435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff260726-9769-4b5a-bd6a-612d9f869e50 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.569058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb6248-c67c-473d-9c9d-8c72fba5aef6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.572492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 178/374] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:37 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:37.573481 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb6248-c67c-473d-9c9d-8c72fba5aef6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.687271 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:37.689636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff260726-9769-4b5a-bd6a-612d9f869e50 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.703930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:37.718948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb6248-c67c-473d-9c9d-8c72fba5aef6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.736647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb277e-a94b-4177-a2f5-2eee9830f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.737370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb277e-a94b-4177-a2f5-2eee9830f162 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.737749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb277e-a94b-4177-a2f5-2eee9830f162 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.738192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb277e-a94b-4177-a2f5-2eee9830f162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.766140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c5e9-2034-4664-899f-bb838516073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.767297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c5e9-2034-4664-899f-bb838516073c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.768196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c5e9-2034-4664-899f-bb838516073c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.768663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c5e9-2034-4664-899f-bb838516073c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.769835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c5e9-2034-4664-899f-bb838516073c None admin] RBAC: Adding query filter params (group.id=c8ecb613aa2e4f91a57228048bb2e9d2, role.id=c59031d5db354a478ab7a9ac0000e098, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:37.770579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c5e9-2034-4664-899f-bb838516073c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.772892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c5e9-2034-4664-899f-bb838516073c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.781692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 179/375] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 19 11:58:37 2022] GET /identity/v3/role_assignments?group.id=c8ecb613aa2e4f91a57228048bb2e9d2&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=c59031d5db354a478ab7a9ac0000e098 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:37.782738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c5e9-2034-4664-899f-bb838516073c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.860850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb277e-a94b-4177-a2f5-2eee9830f162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.862588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb277e-a94b-4177-a2f5-2eee9830f162 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.947396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c5e9-2034-4664-899f-bb838516073c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:38.003488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf02a62-28eb-4ee1-a9fd-7918cd0a2377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:38.003488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf02a62-28eb-4ee1-a9fd-7918cd0a2377 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:38.003488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf02a62-28eb-4ee1-a9fd-7918cd0a2377 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:38.003842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf02a62-28eb-4ee1-a9fd-7918cd0a2377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:38.004367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf02a62-28eb-4ee1-a9fd-7918cd0a2377 None admin] RBAC: Adding query filter params (group.id=c8ecb613aa2e4f91a57228048bb2e9d2, role.id=b320236412e649d9ab1e6787ef8a6870, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:38.004569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf02a62-28eb-4ee1-a9fd-7918cd0a2377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:38.007777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf02a62-28eb-4ee1-a9fd-7918cd0a2377 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:38.019200 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 180/376] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 19 11:58:37 2022] GET /identity/v3/role_assignments?group.id=c8ecb613aa2e4f91a57228048bb2e9d2&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:38.060374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 197/377] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:38.066581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf02a62-28eb-4ee1-a9fd-7918cd0a2377 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:38.081561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:38.105238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08082bc-e8f9-4123-976f-1483f0d99f2a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:38.105568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08082bc-e8f9-4123-976f-1483f0d99f2a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:38.106360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08082bc-e8f9-4123-976f-1483f0d99f2a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:38.108311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 198/378] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:38.114241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89caa9-7546-4a60-b566-bbcd466bf317 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:38.114526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89caa9-7546-4a60-b566-bbcd466bf317 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:38.114800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89caa9-7546-4a60-b566-bbcd466bf317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:38.157989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0c89caa9-7546-4a60-b566-bbcd466bf317 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:38.159276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0c89caa9-7546-4a60-b566-bbcd466bf317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:38.161814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:38.249590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf02a62-28eb-4ee1-a9fd-7918cd0a2377 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:38.306424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf40be-0644-412b-b911-c023b2f2bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:38.307077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf40be-0644-412b-b911-c023b2f2bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:38.307358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf40be-0644-412b-b911-c023b2f2bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:38.307636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf40be-0644-412b-b911-c023b2f2bcd4 None admin] PATH_INFO: `/v3/projects/ae0bb369f1514f798528db70a760243b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:38.308934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf40be-0644-412b-b911-c023b2f2bcd4 None admin] RBAC: Authorizing `identity:get_project(project_id=ae0bb369f1514f798528db70a760243b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:38.310993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf40be-0644-412b-b911-c023b2f2bcd4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:38.316404 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 199/379] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:38.316995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 181/380] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:38 2022] GET /identity/v3/projects/ae0bb369f1514f798528db70a760243b => generated 344 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:38.322141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89caa9-7546-4a60-b566-bbcd466bf317 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:38.433349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89caa9-7546-4a60-b566-bbcd466bf317 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:38.476773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12743978-7aa7-4969-b5f3-7eb657dfbe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:38.477419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743978-7aa7-4969-b5f3-7eb657dfbe96 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:38.477730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743978-7aa7-4969-b5f3-7eb657dfbe96 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:38.478008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743978-7aa7-4969-b5f3-7eb657dfbe96 None admin] PATH_INFO: `/v3/groups/cb1ddfe8dfd5411fad90d1f5c43c805c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:38.498371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12743978-7aa7-4969-b5f3-7eb657dfbe96 None admin] RBAC: Authorizing `identity:get_group(group_id=cb1ddfe8dfd5411fad90d1f5c43c805c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:38.499912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12743978-7aa7-4969-b5f3-7eb657dfbe96 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:38.501952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 200/381] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:38 2022] GET /identity/v3/groups/cb1ddfe8dfd5411fad90d1f5c43c805c => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:38.510567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf40be-0644-412b-b911-c023b2f2bcd4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:38.619820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:38.644350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12743978-7aa7-4969-b5f3-7eb657dfbe96 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:38.647755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:38.653521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf40be-0644-412b-b911-c023b2f2bcd4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:38.728522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74091e-0033-4f7f-b321-3dabe30a6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:38.729154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74091e-0033-4f7f-b321-3dabe30a6cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:38.729436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74091e-0033-4f7f-b321-3dabe30a6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:38.729745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74091e-0033-4f7f-b321-3dabe30a6cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:38.730486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74091e-0033-4f7f-b321-3dabe30a6cb6 None admin] RBAC: Adding query filter params (group.id=cb1ddfe8dfd5411fad90d1f5c43c805c, role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=ae0bb369f1514f798528db70a760243b) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:38.730798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74091e-0033-4f7f-b321-3dabe30a6cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:38.732622 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74091e-0033-4f7f-b321-3dabe30a6cb6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:38.747677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 182/382] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 19 11:58:38 2022] GET /identity/v3/role_assignments?group.id=cb1ddfe8dfd5411fad90d1f5c43c805c&scope.project.id=ae0bb369f1514f798528db70a760243b&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:38.836931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12743978-7aa7-4969-b5f3-7eb657dfbe96 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:38.880209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99c8f6-f630-4593-8b56-df106d78ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:38.880863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99c8f6-f630-4593-8b56-df106d78ff14 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:38.881142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99c8f6-f630-4593-8b56-df106d78ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:38.881416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99c8f6-f630-4593-8b56-df106d78ff14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:38.895176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99c8f6-f630-4593-8b56-df106d78ff14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1b99c8f6-f630-4593-8b56-df106d78ff14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:38.900845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:38.901819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:38.902608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 201/383] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:38.905103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462a64b-29a1-4de8-bccd-5b8cb61f5814 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:38.905103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462a64b-29a1-4de8-bccd-5b8cb61f5814 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:38.905103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462a64b-29a1-4de8-bccd-5b8cb61f5814 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:38.909711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 183/384] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:38.909965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99c8f6-f630-4593-8b56-df106d78ff14 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:38.917341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8ee2d-a3ca-4a6c-951a-97d1b6320d4d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:38.917609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8ee2d-a3ca-4a6c-951a-97d1b6320d4d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:38.917899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8ee2d-a3ca-4a6c-951a-97d1b6320d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:38.963434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-afb8ee2d-a3ca-4a6c-951a-97d1b6320d4d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:38.964690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-afb8ee2d-a3ca-4a6c-951a-97d1b6320d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:39.018596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:39.073734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99c8f6-f630-4593-8b56-df106d78ff14 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:39.116507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc729c-eae9-4ca2-a981-9c965ecb5146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:39.118099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 184/385] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:39.118924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc729c-eae9-4ca2-a981-9c965ecb5146 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:39.119405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc729c-eae9-4ca2-a981-9c965ecb5146 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:39.119893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc729c-eae9-4ca2-a981-9c965ecb5146 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:39.120755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc729c-eae9-4ca2-a981-9c965ecb5146 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:39.121279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc729c-eae9-4ca2-a981-9c965ecb5146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:39.123733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc729c-eae9-4ca2-a981-9c965ecb5146 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:39.133241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 202/386] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:39.138848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8ee2d-a3ca-4a6c-951a-97d1b6320d4d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:39.226897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:39.272933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8ee2d-a3ca-4a6c-951a-97d1b6320d4d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:39.323490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2003-c942-4aad-a19a-11c17c5d2924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:39.324461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2003-c942-4aad-a19a-11c17c5d2924 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:39.325068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2003-c942-4aad-a19a-11c17c5d2924 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:39.325540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2003-c942-4aad-a19a-11c17c5d2924 None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:39.330312 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f2003-c942-4aad-a19a-11c17c5d2924 None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:39.332001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f2003-c942-4aad-a19a-11c17c5d2924 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:39.334140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 185/387] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:39 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:39.339514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc729c-eae9-4ca2-a981-9c965ecb5146 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:39.452512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc729c-eae9-4ca2-a981-9c965ecb5146 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:39.458293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2003-c942-4aad-a19a-11c17c5d2924 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:39.485288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:39.502073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9c533-6323-4276-8f14-1277d51ab2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:39.502968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c533-6323-4276-8f14-1277d51ab2bb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:39.503254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c533-6323-4276-8f14-1277d51ab2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:39.503530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c533-6323-4276-8f14-1277d51ab2bb None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:39.505724 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9c533-6323-4276-8f14-1277d51ab2bb None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:39.507164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9c533-6323-4276-8f14-1277d51ab2bb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:39.509153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 203/388] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:39 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:39.522623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9c533-6323-4276-8f14-1277d51ab2bb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:39.657508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2003-c942-4aad-a19a-11c17c5d2924 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:39.687060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9c533-6323-4276-8f14-1277d51ab2bb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:39.728827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d20eb6-d3b3-4840-9959-4431c3262d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:39.729858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20eb6-d3b3-4840-9959-4431c3262d4e None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:39.730369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20eb6-d3b3-4840-9959-4431c3262d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:39.731496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20eb6-d3b3-4840-9959-4431c3262d4e None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/groups/c8ecb613aa2e4f91a57228048bb2e9d2/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:39.733608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d20eb6-d3b3-4840-9959-4431c3262d4e None admin] RBAC: Authorizing `identity:create_grant(project_id=4b294bc0bf21460b92e0270a4e59e9eb, group_id=c8ecb613aa2e4f91a57228048bb2e9d2, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:39.735355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d20eb6-d3b3-4840-9959-4431c3262d4e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:39.749735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f92b71-205b-4dc7-81b2-ef6a5ad9a30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:39.750376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92b71-205b-4dc7-81b2-ef6a5ad9a30c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:39.750713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92b71-205b-4dc7-81b2-ef6a5ad9a30c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:39.750990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92b71-205b-4dc7-81b2-ef6a5ad9a30c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:39.757755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 204/389] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Sep 19 11:58:39 2022] PUT /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/groups/c8ecb613aa2e4f91a57228048bb2e9d2/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:58:39.760837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:39.782394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f92b71-205b-4dc7-81b2-ef6a5ad9a30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f3f92b71-205b-4dc7-81b2-ef6a5ad9a30c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:39.787725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:39.788669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:39.789982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 186/390] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:39.797611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d20eb6-d3b3-4840-9959-4431c3262d4e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:39.875453 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:39.931787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d20eb6-d3b3-4840-9959-4431c3262d4e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:39.967846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e81aeb-737a-4632-a317-3674d28e3fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:39.968818 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e81aeb-737a-4632-a317-3674d28e3fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:39.969340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e81aeb-737a-4632-a317-3674d28e3fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:39.969826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e81aeb-737a-4632-a317-3674d28e3fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:39.970703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e81aeb-737a-4632-a317-3674d28e3fb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:39.971197 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e81aeb-737a-4632-a317-3674d28e3fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:39.972825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e81aeb-737a-4632-a317-3674d28e3fb8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:39.987619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 205/391] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:39.989333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f92b71-205b-4dc7-81b2-ef6a5ad9a30c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:40.111461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f92b71-205b-4dc7-81b2-ef6a5ad9a30c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:40.148260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eab129-3d20-437f-8a2a-f7002ddef6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:40.149269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eab129-3d20-437f-8a2a-f7002ddef6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:40.149766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eab129-3d20-437f-8a2a-f7002ddef6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:40.150232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eab129-3d20-437f-8a2a-f7002ddef6d1 None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:40.151565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eab129-3d20-437f-8a2a-f7002ddef6d1 None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:40.153957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eab129-3d20-437f-8a2a-f7002ddef6d1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:40.157017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 187/392] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:39 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:40.162130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e81aeb-737a-4632-a317-3674d28e3fb8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:40.276588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e81aeb-737a-4632-a317-3674d28e3fb8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:40.306998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:40.317679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476b596-69b4-4fa6-819a-1c5d03e93b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:40.318722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476b596-69b4-4fa6-819a-1c5d03e93b76 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:40.319197 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476b596-69b4-4fa6-819a-1c5d03e93b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:40.319662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476b596-69b4-4fa6-819a-1c5d03e93b76 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:40.321224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476b596-69b4-4fa6-819a-1c5d03e93b76 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:40.322923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476b596-69b4-4fa6-819a-1c5d03e93b76 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:40.329721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 206/393] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:40 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:40.332351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eab129-3d20-437f-8a2a-f7002ddef6d1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:40.403277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:40.430943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4abb7-180a-43c0-90b8-5e05d758ee46 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:40.431910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4abb7-180a-43c0-90b8-5e05d758ee46 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:40.432374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4abb7-180a-43c0-90b8-5e05d758ee46 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:40.437736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 207/394] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:40.447153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890dfc3-926b-4b83-b5be-8dc9c4cdf833 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:40.447702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890dfc3-926b-4b83-b5be-8dc9c4cdf833 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:40.448191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890dfc3-926b-4b83-b5be-8dc9c4cdf833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:40.457025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eab129-3d20-437f-8a2a-f7002ddef6d1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:40.471269 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5890dfc3-926b-4b83-b5be-8dc9c4cdf833 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:40.473863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5890dfc3-926b-4b83-b5be-8dc9c4cdf833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:40.535019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6113a-19cf-405e-867a-a22126d6ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:40.535599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6113a-19cf-405e-867a-a22126d6ef63 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:40.535878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6113a-19cf-405e-867a-a22126d6ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:40.536156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6113a-19cf-405e-867a-a22126d6ef63 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/groups/c8ecb613aa2e4f91a57228048bb2e9d2/roles/c59031d5db354a478ab7a9ac0000e098` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:40.550453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6113a-19cf-405e-867a-a22126d6ef63 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b294bc0bf21460b92e0270a4e59e9eb, group_id=c8ecb613aa2e4f91a57228048bb2e9d2, role_id=c59031d5db354a478ab7a9ac0000e098)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:40.551934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6113a-19cf-405e-867a-a22126d6ef63 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:40.558204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 208/395] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:40.580123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 188/396] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Sep 19 11:58:40 2022] PUT /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb/groups/c8ecb613aa2e4f91a57228048bb2e9d2/roles/c59031d5db354a478ab7a9ac0000e098 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:58:40.968130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11e97c-577c-444a-8b9e-109b01dc349c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:40.968415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11e97c-577c-444a-8b9e-109b01dc349c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:40.968914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11e97c-577c-444a-8b9e-109b01dc349c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:40.970349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 209/397] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:40.977188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430416-c840-45b7-a93a-c4e97c8b9ca8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:40.977471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430416-c840-45b7-a93a-c4e97c8b9ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:40.977770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430416-c840-45b7-a93a-c4e97c8b9ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:40.997646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-19430416-c840-45b7-a93a-c4e97c8b9ca8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:40.998769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11e97c-577c-444a-8b9e-109b01dc349c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:40.998880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-19430416-c840-45b7-a93a-c4e97c8b9ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:41.129993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 189/398] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:41.178875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11e97c-577c-444a-8b9e-109b01dc349c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:41.196752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:41.227871 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8d2b-1d5a-404d-9d89-f7c305cce471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:41.228410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8d2b-1d5a-404d-9d89-f7c305cce471 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:41.228684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8d2b-1d5a-404d-9d89-f7c305cce471 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:41.228952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8d2b-1d5a-404d-9d89-f7c305cce471 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:41.241756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b8d2b-1d5a-404d-9d89-f7c305cce471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9b3b8d2b-1d5a-404d-9d89-f7c305cce471 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:41.250787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:41.251760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:41.252567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 210/399] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:41.259848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19430416-c840-45b7-a93a-c4e97c8b9ca8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:41.333356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:41.401461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19430416-c840-45b7-a93a-c4e97c8b9ca8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:41.445602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84501a0-f5e0-48df-a1d8-31b241501053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:41.446247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84501a0-f5e0-48df-a1d8-31b241501053 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:41.446527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84501a0-f5e0-48df-a1d8-31b241501053 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:41.446802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84501a0-f5e0-48df-a1d8-31b241501053 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:41.447480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84501a0-f5e0-48df-a1d8-31b241501053 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:41.447785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84501a0-f5e0-48df-a1d8-31b241501053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:41.449161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84501a0-f5e0-48df-a1d8-31b241501053 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:41.461350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 190/400] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:41.467861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8d2b-1d5a-404d-9d89-f7c305cce471 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:41.555074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84501a0-f5e0-48df-a1d8-31b241501053 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:41.671686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8d2b-1d5a-404d-9d89-f7c305cce471 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:41.680980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84501a0-f5e0-48df-a1d8-31b241501053 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:41.709973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:41.722913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3084ce-a33a-41d1-a851-5f4af9d63dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:41.724080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3084ce-a33a-41d1-a851-5f4af9d63dec None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:41.724450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3084ce-a33a-41d1-a851-5f4af9d63dec None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:41.724901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3084ce-a33a-41d1-a851-5f4af9d63dec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:41.739968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3084ce-a33a-41d1-a851-5f4af9d63dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5e3084ce-a33a-41d1-a851-5f4af9d63dec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:41.745494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:41.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:41.748125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:41.748819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190bc84-c4bb-4070-a432-31062511070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:41.748819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190bc84-c4bb-4070-a432-31062511070e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:41.748819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190bc84-c4bb-4070-a432-31062511070e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:41.748819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190bc84-c4bb-4070-a432-31062511070e None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:41.749406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190bc84-c4bb-4070-a432-31062511070e None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:41.750879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190bc84-c4bb-4070-a432-31062511070e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:41.752733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 211/402] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:41 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:41.752888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 191/402] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:41.756441 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190bc84-c4bb-4070-a432-31062511070e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:41.758311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3084ce-a33a-41d1-a851-5f4af9d63dec None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:41.823838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:41.911457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190bc84-c4bb-4070-a432-31062511070e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:41.915914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3084ce-a33a-41d1-a851-5f4af9d63dec None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:41.957772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debee2e-9acf-447d-ad76-1c4cabe72670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:41.958406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debee2e-9acf-447d-ad76-1c4cabe72670 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:41.958693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debee2e-9acf-447d-ad76-1c4cabe72670 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:41.958967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debee2e-9acf-447d-ad76-1c4cabe72670 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:41.959656 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debee2e-9acf-447d-ad76-1c4cabe72670 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:41.959961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debee2e-9acf-447d-ad76-1c4cabe72670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:41.960988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0842e-7917-43d5-bdb8-b66d87c35537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:41.961365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debee2e-9acf-447d-ad76-1c4cabe72670 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:41.961656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0842e-7917-43d5-bdb8-b66d87c35537 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:41.961940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0842e-7917-43d5-bdb8-b66d87c35537 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:41.962211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0842e-7917-43d5-bdb8-b66d87c35537 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:41.963638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0842e-7917-43d5-bdb8-b66d87c35537 None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:41.966275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0842e-7917-43d5-bdb8-b66d87c35537 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:41.968774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 192/403] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:41 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:41.970117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb2bfc-fdc2-4cc9-b328-df9a340fe7df None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:41.970398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb2bfc-fdc2-4cc9-b328-df9a340fe7df None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:41.970670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb2bfc-fdc2-4cc9-b328-df9a340fe7df None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:41.972151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 193/404] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:41.975640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 212/405] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:41.976814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb2bfc-fdc2-4cc9-b328-df9a340fe7df None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:41.985940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6255-873a-4e84-a81f-679e1d98fed6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:41.986245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6255-873a-4e84-a81f-679e1d98fed6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:41.986521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6255-873a-4e84-a81f-679e1d98fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:42.006052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-90ca6255-873a-4e84-a81f-679e1d98fed6 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:42.007916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-90ca6255-873a-4e84-a81f-679e1d98fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:42.030888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:42.091602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 213/406] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:42.092381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca6255-873a-4e84-a81f-679e1d98fed6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:42.099286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb2bfc-fdc2-4cc9-b328-df9a340fe7df None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:42.128205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:42.161517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa206e0-7b5c-49ae-bd08-9af9a086f18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:42.162220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa206e0-7b5c-49ae-bd08-9af9a086f18c None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:42.162504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa206e0-7b5c-49ae-bd08-9af9a086f18c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:42.162782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa206e0-7b5c-49ae-bd08-9af9a086f18c None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/groups/c8ecb613aa2e4f91a57228048bb2e9d2/roles/c59031d5db354a478ab7a9ac0000e098` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:42.167104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa206e0-7b5c-49ae-bd08-9af9a086f18c None admin] RBAC: Authorizing `identity:create_grant(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29, group_id=c8ecb613aa2e4f91a57228048bb2e9d2, role_id=c59031d5db354a478ab7a9ac0000e098)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:42.168935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa206e0-7b5c-49ae-bd08-9af9a086f18c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:42.197569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 194/407] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Sep 19 11:58:41 2022] PUT /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/groups/c8ecb613aa2e4f91a57228048bb2e9d2/roles/c59031d5db354a478ab7a9ac0000e098 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:58:42.213176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca6255-873a-4e84-a81f-679e1d98fed6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:42.254397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751da2-8ef2-4ea2-80e5-18639691d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:42.255049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751da2-8ef2-4ea2-80e5-18639691d89d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:42.255329 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751da2-8ef2-4ea2-80e5-18639691d89d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:42.255596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751da2-8ef2-4ea2-80e5-18639691d89d None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:42.256728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e751da2-8ef2-4ea2-80e5-18639691d89d None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:42.258209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e751da2-8ef2-4ea2-80e5-18639691d89d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:42.264951 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 214/408] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:42 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:42.266422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa206e0-7b5c-49ae-bd08-9af9a086f18c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:42.410167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa206e0-7b5c-49ae-bd08-9af9a086f18c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:42.412508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:42.458818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e33b72-a423-49a4-8480-dc20571466a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:42.459733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e33b72-a423-49a4-8480-dc20571466a1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:42.460146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e33b72-a423-49a4-8480-dc20571466a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:42.460591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e33b72-a423-49a4-8480-dc20571466a1 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:42.466877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e33b72-a423-49a4-8480-dc20571466a1 None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:42.468384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e33b72-a423-49a4-8480-dc20571466a1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:42.470541 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 195/409] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:42 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:42.472025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751da2-8ef2-4ea2-80e5-18639691d89d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:42.477175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e33b72-a423-49a4-8480-dc20571466a1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:42.622715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:42.625695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751da2-8ef2-4ea2-80e5-18639691d89d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:42.641142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e33b72-a423-49a4-8480-dc20571466a1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:42.674459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3d72-2a01-4f62-b2f6-ca592c449fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:42.675391 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3d72-2a01-4f62-b2f6-ca592c449fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:42.675671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3d72-2a01-4f62-b2f6-ca592c449fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:42.675946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3d72-2a01-4f62-b2f6-ca592c449fe8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:42.687185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3d72-2a01-4f62-b2f6-ca592c449fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2bfb3d72-2a01-4f62-b2f6-ca592c449fe8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:42.692314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:42.693193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:42.694063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:42.697943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 215/410] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:42.700284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3d72-2a01-4f62-b2f6-ca592c449fe8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:42.714396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3b876-650b-40a5-8bec-e862394b6886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:42.716160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3b876-650b-40a5-8bec-e862394b6886 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:42.716739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3b876-650b-40a5-8bec-e862394b6886 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:42.717218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3b876-650b-40a5-8bec-e862394b6886 None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/groups/c8ecb613aa2e4f91a57228048bb2e9d2/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:42.720943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3b876-650b-40a5-8bec-e862394b6886 None admin] RBAC: Authorizing `identity:create_grant(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29, group_id=c8ecb613aa2e4f91a57228048bb2e9d2, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:42.722831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3b876-650b-40a5-8bec-e862394b6886 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:42.744009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 196/411] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Sep 19 11:58:42 2022] PUT /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29/groups/c8ecb613aa2e4f91a57228048bb2e9d2/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:42.822947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3d72-2a01-4f62-b2f6-ca592c449fe8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:42.854179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462b59-57e8-4a02-99ba-d8c80f6cf53a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:42.854818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462b59-57e8-4a02-99ba-d8c80f6cf53a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:42.855288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462b59-57e8-4a02-99ba-d8c80f6cf53a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:42.857529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 197/412] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:42.863635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571dfba-9be9-484b-b9d3-f2a26383442e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:42.864254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571dfba-9be9-484b-b9d3-f2a26383442e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:42.864773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571dfba-9be9-484b-b9d3-f2a26383442e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:42.869408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b2487-1b4c-418a-948e-4281a055961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:42.870070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b2487-1b4c-418a-948e-4281a055961f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:42.870407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b2487-1b4c-418a-948e-4281a055961f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:42.870867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b2487-1b4c-418a-948e-4281a055961f None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:42.872226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b2487-1b4c-418a-948e-4281a055961f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:42.872533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b2487-1b4c-418a-948e-4281a055961f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:42.881727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b2487-1b4c-418a-948e-4281a055961f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:42.885476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 216/413] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:42.893005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b2487-1b4c-418a-948e-4281a055961f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:42.898297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8571dfba-9be9-484b-b9d3-f2a26383442e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:42.900002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8571dfba-9be9-484b-b9d3-f2a26383442e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:42.930674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:42.936894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:43.010945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 198/414] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:43.053011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b2487-1b4c-418a-948e-4281a055961f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:43.089485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c1be9-30bb-4f92-80d3-6ce373b3e4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:43.090189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c1be9-30bb-4f92-80d3-6ce373b3e4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.090482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c1be9-30bb-4f92-80d3-6ce373b3e4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.090779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c1be9-30bb-4f92-80d3-6ce373b3e4a6 None admin] PATH_INFO: `/v3/groups/cb1ddfe8dfd5411fad90d1f5c43c805c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.092008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c1be9-30bb-4f92-80d3-6ce373b3e4a6 None admin] RBAC: Authorizing `identity:get_group(group_id=cb1ddfe8dfd5411fad90d1f5c43c805c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:43.093452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c1be9-30bb-4f92-80d3-6ce373b3e4a6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:43.095356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 217/415] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:42 2022] GET /identity/v3/groups/cb1ddfe8dfd5411fad90d1f5c43c805c => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:43.101154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571dfba-9be9-484b-b9d3-f2a26383442e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:43.240495 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571dfba-9be9-484b-b9d3-f2a26383442e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:43.290526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fe91-fb45-4f07-82db-41a84f7eb649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:43.291168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fe91-fb45-4f07-82db-41a84f7eb649 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.291449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fe91-fb45-4f07-82db-41a84f7eb649 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.291726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fe91-fb45-4f07-82db-41a84f7eb649 None admin] PATH_INFO: `/v3/projects/ae0bb369f1514f798528db70a760243b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.292854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77fe91-fb45-4f07-82db-41a84f7eb649 None admin] RBAC: Authorizing `identity:get_project(project_id=ae0bb369f1514f798528db70a760243b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:43.294364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77fe91-fb45-4f07-82db-41a84f7eb649 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:43.296303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 199/416] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:43 2022] GET /identity/v3/projects/ae0bb369f1514f798528db70a760243b => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:43.301958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c1be9-30bb-4f92-80d3-6ce373b3e4a6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:43.321312 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fe91-fb45-4f07-82db-41a84f7eb649 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:43.368944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:43.432280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:43.445393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c1be9-30bb-4f92-80d3-6ce373b3e4a6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:43.487013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142a30c-9f18-40b3-8d4f-4318c8f369cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:43.487764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142a30c-9f18-40b3-8d4f-4318c8f369cb None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.487958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142a30c-9f18-40b3-8d4f-4318c8f369cb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.488233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142a30c-9f18-40b3-8d4f-4318c8f369cb None admin] PATH_INFO: `/v3/projects/ae0bb369f1514f798528db70a760243b/groups/cb1ddfe8dfd5411fad90d1f5c43c805c/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.490344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142a30c-9f18-40b3-8d4f-4318c8f369cb None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bb369f1514f798528db70a760243b, group_id=cb1ddfe8dfd5411fad90d1f5c43c805c, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:43.491840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142a30c-9f18-40b3-8d4f-4318c8f369cb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:43.507222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 218/417] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Sep 19 11:58:43 2022] PUT /identity/v3/projects/ae0bb369f1514f798528db70a760243b/groups/cb1ddfe8dfd5411fad90d1f5c43c805c/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:43.535213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fe91-fb45-4f07-82db-41a84f7eb649 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:43.568106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a302272-4e22-4e3c-9a82-e3c7d1d7f967 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.568444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a302272-4e22-4e3c-9a82-e3c7d1d7f967 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.568654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a302272-4e22-4e3c-9a82-e3c7d1d7f967 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.570435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 219/418] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:43.577022 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29394-76b1-459c-a337-410a6f467bdc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.577330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29394-76b1-459c-a337-410a6f467bdc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.577573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29394-76b1-459c-a337-410a6f467bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.603395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-39e29394-76b1-459c-a337-410a6f467bdc None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:43.604622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-39e29394-76b1-459c-a337-410a6f467bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:43.606388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002a3cf-3c47-4344-a399-c5e728d31949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:43.607049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002a3cf-3c47-4344-a399-c5e728d31949 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.607343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002a3cf-3c47-4344-a399-c5e728d31949 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.607605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002a3cf-3c47-4344-a399-c5e728d31949 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.629127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002a3cf-3c47-4344-a399-c5e728d31949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3002a3cf-3c47-4344-a399-c5e728d31949 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:43.634154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:43.635046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:43.635816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:43.637808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 200/419] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:43.643151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002a3cf-3c47-4344-a399-c5e728d31949 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:43.729406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 220/420] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:43.796050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:43.807414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002a3cf-3c47-4344-a399-c5e728d31949 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:43.849190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76865b6-4a35-4d85-8cba-23dacafd7d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:43.849832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76865b6-4a35-4d85-8cba-23dacafd7d21 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.850112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76865b6-4a35-4d85-8cba-23dacafd7d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.850387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76865b6-4a35-4d85-8cba-23dacafd7d21 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.851059 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76865b6-4a35-4d85-8cba-23dacafd7d21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:43.851361 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76865b6-4a35-4d85-8cba-23dacafd7d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:43.852807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76865b6-4a35-4d85-8cba-23dacafd7d21 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:43.861763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 201/421] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:43.867643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e29394-76b1-459c-a337-410a6f467bdc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:43.984748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:44.011306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e29394-76b1-459c-a337-410a6f467bdc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.061980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4239f01-055e-4db8-98e7-09623683f44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.062611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4239f01-055e-4db8-98e7-09623683f44f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.062887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4239f01-055e-4db8-98e7-09623683f44f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.063170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4239f01-055e-4db8-98e7-09623683f44f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.133963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76865b6-4a35-4d85-8cba-23dacafd7d21 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.149907 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4239f01-055e-4db8-98e7-09623683f44f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.151369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4239f01-055e-4db8-98e7-09623683f44f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.283766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:44.307444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 221/422] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:44.313982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4239f01-055e-4db8-98e7-09623683f44f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.367739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76865b6-4a35-4d85-8cba-23dacafd7d21 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.419058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4239f01-055e-4db8-98e7-09623683f44f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.454041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d53352-b2b6-4b34-873f-25fc37f66634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.454667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53352-b2b6-4b34-873f-25fc37f66634 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.454943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53352-b2b6-4b34-873f-25fc37f66634 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.455207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53352-b2b6-4b34-873f-25fc37f66634 None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.456311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d53352-b2b6-4b34-873f-25fc37f66634 None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.457747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d53352-b2b6-4b34-873f-25fc37f66634 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.462295 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f528229-dd98-46ce-abf3-82ab13cfc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.463173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f528229-dd98-46ce-abf3-82ab13cfc24a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.463659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f528229-dd98-46ce-abf3-82ab13cfc24a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.463856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 222/423] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:44 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:44.464332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f528229-dd98-46ce-abf3-82ab13cfc24a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.465495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d53352-b2b6-4b34-873f-25fc37f66634 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.490507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f528229-dd98-46ce-abf3-82ab13cfc24a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-9f528229-dd98-46ce-abf3-82ab13cfc24a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:44.496136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:44.497379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:44.498230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:44.500846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 202/424] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:44.506509 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f528229-dd98-46ce-abf3-82ab13cfc24a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.517762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:44.533816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:44.577555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d53352-b2b6-4b34-873f-25fc37f66634 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.623568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76444-6f27-4ff0-9e6b-41f79f3b5f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.624452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76444-6f27-4ff0-9e6b-41f79f3b5f38 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.624873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76444-6f27-4ff0-9e6b-41f79f3b5f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.625377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76444-6f27-4ff0-9e6b-41f79f3b5f38 None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.626712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e76444-6f27-4ff0-9e6b-41f79f3b5f38 None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.628276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e76444-6f27-4ff0-9e6b-41f79f3b5f38 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.635133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 223/425] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:44 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:44.636556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76444-6f27-4ff0-9e6b-41f79f3b5f38 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.665444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f528229-dd98-46ce-abf3-82ab13cfc24a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.700932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f89824-9800-4b17-9bc2-db95f73b6cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.701581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f89824-9800-4b17-9bc2-db95f73b6cec None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.701887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f89824-9800-4b17-9bc2-db95f73b6cec None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.702178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f89824-9800-4b17-9bc2-db95f73b6cec None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.702819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f89824-9800-4b17-9bc2-db95f73b6cec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:44.703123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f89824-9800-4b17-9bc2-db95f73b6cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.704489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f89824-9800-4b17-9bc2-db95f73b6cec None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.713269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 203/426] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:44.719772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f89824-9800-4b17-9bc2-db95f73b6cec None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.751884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76444-6f27-4ff0-9e6b-41f79f3b5f38 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.770274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:44.791426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c5f88-e5a0-4e2a-86ec-9d1e3ec6a36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.792405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c5f88-e5a0-4e2a-86ec-9d1e3ec6a36d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.792873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c5f88-e5a0-4e2a-86ec-9d1e3ec6a36d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.793974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c5f88-e5a0-4e2a-86ec-9d1e3ec6a36d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.795042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c5f88-e5a0-4e2a-86ec-9d1e3ec6a36d None admin] RBAC: Adding query filter params (group.id=c8ecb613aa2e4f91a57228048bb2e9d2, role.id=b320236412e649d9ab1e6787ef8a6870, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:44.795547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c5f88-e5a0-4e2a-86ec-9d1e3ec6a36d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.797170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c5f88-e5a0-4e2a-86ec-9d1e3ec6a36d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.797773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:44.813781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 224/427] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 19 11:58:44 2022] GET /identity/v3/role_assignments?group.id=c8ecb613aa2e4f91a57228048bb2e9d2&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:44.825532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f89824-9800-4b17-9bc2-db95f73b6cec None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.864883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501d174-ab7c-45f2-8588-f9575af1b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.865428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501d174-ab7c-45f2-8588-f9575af1b974 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.865734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501d174-ab7c-45f2-8588-f9575af1b974 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.866010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501d174-ab7c-45f2-8588-f9575af1b974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.945338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501d174-ab7c-45f2-8588-f9575af1b974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.946917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501d174-ab7c-45f2-8588-f9575af1b974 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:45.032374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:45.057102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 204/428] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:45.063328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c5f88-e5a0-4e2a-86ec-9d1e3ec6a36d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:45.177241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c5f88-e5a0-4e2a-86ec-9d1e3ec6a36d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:45.204434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcebb9f-5806-4b9b-8adb-946e47ee0ec3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.204738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcebb9f-5806-4b9b-8adb-946e47ee0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.204978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcebb9f-5806-4b9b-8adb-946e47ee0ec3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.207662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 205/429] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:45.215859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27e258-27a8-4f73-8d73-d67fc7c316ae None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.216134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27e258-27a8-4f73-8d73-d67fc7c316ae None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.216406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27e258-27a8-4f73-8d73-d67fc7c316ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.232670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a41e1-b583-4e70-b739-0b8c0a1ce93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:45.233663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a41e1-b583-4e70-b739-0b8c0a1ce93d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.234161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a41e1-b583-4e70-b739-0b8c0a1ce93d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.234636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a41e1-b583-4e70-b739-0b8c0a1ce93d None admin] PATH_INFO: `/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.236898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a41e1-b583-4e70-b739-0b8c0a1ce93d None admin] RBAC: Authorizing `identity:get_project(project_id=4b294bc0bf21460b92e0270a4e59e9eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:45.238570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a41e1-b583-4e70-b739-0b8c0a1ce93d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:45.240726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4c27e258-27a8-4f73-8d73-d67fc7c316ae None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:45.240956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 225/430] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:45 2022] GET /identity/v3/projects/4b294bc0bf21460b92e0270a4e59e9eb => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:45.247595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4c27e258-27a8-4f73-8d73-d67fc7c316ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:45.252992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a41e1-b583-4e70-b739-0b8c0a1ce93d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:45.332386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:45.365736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 206/431] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:45.386199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92962e-d1dc-4b0b-828d-074621f28405 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.386858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92962e-d1dc-4b0b-828d-074621f28405 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.387840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92962e-d1dc-4b0b-828d-074621f28405 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.390009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 207/432] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:45.396419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e135805-e205-4b42-be0d-3db9f584cd44 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.396939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e135805-e205-4b42-be0d-3db9f584cd44 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.397429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e135805-e205-4b42-be0d-3db9f584cd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.403200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a41e1-b583-4e70-b739-0b8c0a1ce93d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:45.419527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0e135805-e205-4b42-be0d-3db9f584cd44 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:45.421410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0e135805-e205-4b42-be0d-3db9f584cd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:45.443513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c038-2a10-4db7-a016-49b8421c1080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:45.444145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c038-2a10-4db7-a016-49b8421c1080 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.444433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c038-2a10-4db7-a016-49b8421c1080 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.444863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c038-2a10-4db7-a016-49b8421c1080 None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.446335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c038-2a10-4db7-a016-49b8421c1080 None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:45.447787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c038-2a10-4db7-a016-49b8421c1080 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:45.450372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 226/433] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:45 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:45.457554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c038-2a10-4db7-a016-49b8421c1080 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:45.517657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 208/434] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:45.599688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c038-2a10-4db7-a016-49b8421c1080 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:45.618521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:45.638095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125172a-1489-48dc-91fd-3060f0e3a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:45.638708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125172a-1489-48dc-91fd-3060f0e3a313 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.638987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125172a-1489-48dc-91fd-3060f0e3a313 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.639260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125172a-1489-48dc-91fd-3060f0e3a313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.639977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125172a-1489-48dc-91fd-3060f0e3a313 None admin] RBAC: Adding query filter params (group.id=c8ecb613aa2e4f91a57228048bb2e9d2, role.id=c59031d5db354a478ab7a9ac0000e098, scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:45.640286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125172a-1489-48dc-91fd-3060f0e3a313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:45.641735 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125172a-1489-48dc-91fd-3060f0e3a313 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:45.650054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 227/435] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 19 11:58:45 2022] GET /identity/v3/role_assignments?group.id=c8ecb613aa2e4f91a57228048bb2e9d2&scope.project.id=4b294bc0bf21460b92e0270a4e59e9eb&role.id=c59031d5db354a478ab7a9ac0000e098 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:45.666730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e135805-e205-4b42-be0d-3db9f584cd44 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:45.710422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:45.790111 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e135805-e205-4b42-be0d-3db9f584cd44 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:45.835160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154d15-331e-4dd9-a887-a6c9f7524f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:45.835829 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154d15-331e-4dd9-a887-a6c9f7524f1c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.836102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154d15-331e-4dd9-a887-a6c9f7524f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.836368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154d15-331e-4dd9-a887-a6c9f7524f1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.851979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57154d15-331e-4dd9-a887-a6c9f7524f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:45.856833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125172a-1489-48dc-91fd-3060f0e3a313 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-57154d15-331e-4dd9-a887-a6c9f7524f1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:45.858074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:45.858925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:45.859695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 209/436] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:45.866705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154d15-331e-4dd9-a887-a6c9f7524f1c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:45.979532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:45.987143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154d15-331e-4dd9-a887-a6c9f7524f1c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:45.988151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125172a-1489-48dc-91fd-3060f0e3a313 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:46.031008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1254b4b-e8e4-4abb-ba09-a194c9f58017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.031946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1254b4b-e8e4-4abb-ba09-a194c9f58017 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.032225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1254b4b-e8e4-4abb-ba09-a194c9f58017 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.032493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1254b4b-e8e4-4abb-ba09-a194c9f58017 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.033257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1254b4b-e8e4-4abb-ba09-a194c9f58017 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:46.033516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeac45e-9d69-4dc5-9cab-1b56884cc1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.033663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1254b4b-e8e4-4abb-ba09-a194c9f58017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:46.034230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeac45e-9d69-4dc5-9cab-1b56884cc1cd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.034520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeac45e-9d69-4dc5-9cab-1b56884cc1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.034797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeac45e-9d69-4dc5-9cab-1b56884cc1cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.034947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1254b4b-e8e4-4abb-ba09-a194c9f58017 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:46.049729 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 210/437] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:46.050747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeac45e-9d69-4dc5-9cab-1b56884cc1cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:46.054638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1254b4b-e8e4-4abb-ba09-a194c9f58017 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-fbeac45e-9d69-4dc5-9cab-1b56884cc1cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:46.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:46.057274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:46.058315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 228/438] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:46.067326 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeac45e-9d69-4dc5-9cab-1b56884cc1cd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:46.120533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:46.189311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1254b4b-e8e4-4abb-ba09-a194c9f58017 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:46.203742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeac45e-9d69-4dc5-9cab-1b56884cc1cd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:46.226778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67880e2-45b3-4a21-85e4-73baea3cd44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.227500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67880e2-45b3-4a21-85e4-73baea3cd44f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.227788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67880e2-45b3-4a21-85e4-73baea3cd44f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.228062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67880e2-45b3-4a21-85e4-73baea3cd44f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.242834 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb06a1-f244-4e3d-a93a-cfe326b0b89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.243365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb06a1-f244-4e3d-a93a-cfe326b0b89b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.243641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb06a1-f244-4e3d-a93a-cfe326b0b89b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.243912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb06a1-f244-4e3d-a93a-cfe326b0b89b None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.244572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb06a1-f244-4e3d-a93a-cfe326b0b89b None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:46.244874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb06a1-f244-4e3d-a93a-cfe326b0b89b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:46.246446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb06a1-f244-4e3d-a93a-cfe326b0b89b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:46.255369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 229/439] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:58:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:46.256122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:46.261204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb06a1-f244-4e3d-a93a-cfe326b0b89b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:46.302614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67880e2-45b3-4a21-85e4-73baea3cd44f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:46.304084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67880e2-45b3-4a21-85e4-73baea3cd44f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:46.365483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb06a1-f244-4e3d-a93a-cfe326b0b89b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:46.366992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:46.400348 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec946fa-ac20-439d-9d27-4b5a6556f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.400953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec946fa-ac20-439d-9d27-4b5a6556f842 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.401231 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec946fa-ac20-439d-9d27-4b5a6556f842 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.401504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec946fa-ac20-439d-9d27-4b5a6556f842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.403834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 211/440] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:46.405075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a5c65-b75c-4d1a-9d25-b6921d12cbe4 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.405354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a5c65-b75c-4d1a-9d25-b6921d12cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.405643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a5c65-b75c-4d1a-9d25-b6921d12cbe4 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.406863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 212/441] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:46.411627 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a5c65-b75c-4d1a-9d25-b6921d12cbe4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:46.467067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:46.473380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec946fa-ac20-439d-9d27-4b5a6556f842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:46.474867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec946fa-ac20-439d-9d27-4b5a6556f842 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:46.510599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a5c65-b75c-4d1a-9d25-b6921d12cbe4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:46.544300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6c12a-c7e3-4892-9458-01ad52c4171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.544915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6c12a-c7e3-4892-9458-01ad52c4171b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.545192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6c12a-c7e3-4892-9458-01ad52c4171b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.545465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6c12a-c7e3-4892-9458-01ad52c4171b None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.546596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6c12a-c7e3-4892-9458-01ad52c4171b None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:46.548039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6c12a-c7e3-4892-9458-01ad52c4171b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:46.549671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 213/442] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:46 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:46.550765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086998d1-6be3-40cf-88cb-25087ebb06d7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.551045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086998d1-6be3-40cf-88cb-25087ebb06d7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.551318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086998d1-6be3-40cf-88cb-25087ebb06d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.568295 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-086998d1-6be3-40cf-88cb-25087ebb06d7 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:46.569467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-086998d1-6be3-40cf-88cb-25087ebb06d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:46.570922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 230/443] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:46.571750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec946fa-ac20-439d-9d27-4b5a6556f842 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:46.574033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:46.636305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 214/444] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:46.637955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086998d1-6be3-40cf-88cb-25087ebb06d7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:46.675464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec946fa-ac20-439d-9d27-4b5a6556f842 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:46.705432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:46.711747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fb75a-3644-4ad5-ab87-8093046cf50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.712470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fb75a-3644-4ad5-ab87-8093046cf50d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.712751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fb75a-3644-4ad5-ab87-8093046cf50d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.713023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fb75a-3644-4ad5-ab87-8093046cf50d None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.714144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fb75a-3644-4ad5-ab87-8093046cf50d None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:46.715688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fb75a-3644-4ad5-ab87-8093046cf50d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:46.721918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 231/445] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:46 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:46.722858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fb75a-3644-4ad5-ab87-8093046cf50d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:46.757872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086998d1-6be3-40cf-88cb-25087ebb06d7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:46.795251 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d463b7-9a84-4337-a584-92cbac98f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.796188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d463b7-9a84-4337-a584-92cbac98f3af None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.796664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d463b7-9a84-4337-a584-92cbac98f3af None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.797145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d463b7-9a84-4337-a584-92cbac98f3af None admin] PATH_INFO: `/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.797275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:46.798376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d463b7-9a84-4337-a584-92cbac98f3af None admin] RBAC: Authorizing `identity:get_project(project_id=6996da8c3b0c4e7c8a54a1fc1b043b29)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:46.799869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d463b7-9a84-4337-a584-92cbac98f3af None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:46.801815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 215/446] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:46 2022] GET /identity/v3/projects/6996da8c3b0c4e7c8a54a1fc1b043b29 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:46.806799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d463b7-9a84-4337-a584-92cbac98f3af None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:46.832556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fb75a-3644-4ad5-ab87-8093046cf50d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:46.869210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe107413-90d1-41d4-b14f-ba2739638842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.869847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe107413-90d1-41d4-b14f-ba2739638842 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.870135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe107413-90d1-41d4-b14f-ba2739638842 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.870409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe107413-90d1-41d4-b14f-ba2739638842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.871649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe107413-90d1-41d4-b14f-ba2739638842 None admin] RBAC: Adding query filter params (group.id=c8ecb613aa2e4f91a57228048bb2e9d2, role.id=c59031d5db354a478ab7a9ac0000e098, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:46.872053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe107413-90d1-41d4-b14f-ba2739638842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:46.873517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe107413-90d1-41d4-b14f-ba2739638842 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:46.889255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 232/447] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 19 11:58:46 2022] GET /identity/v3/role_assignments?group.id=c8ecb613aa2e4f91a57228048bb2e9d2&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=c59031d5db354a478ab7a9ac0000e098 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:46.905927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe107413-90d1-41d4-b14f-ba2739638842 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:46.922633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d463b7-9a84-4337-a584-92cbac98f3af None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:46.947731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:46.962272 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa1eea-bcdd-4285-95f0-03fc8bfe79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.962917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa1eea-bcdd-4285-95f0-03fc8bfe79b0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.963187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa1eea-bcdd-4285-95f0-03fc8bfe79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.963458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa1eea-bcdd-4285-95f0-03fc8bfe79b0 None admin] PATH_INFO: `/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.964629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa1eea-bcdd-4285-95f0-03fc8bfe79b0 None admin] RBAC: Authorizing `identity:get_group(group_id=c8ecb613aa2e4f91a57228048bb2e9d2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:46.966661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa1eea-bcdd-4285-95f0-03fc8bfe79b0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:46.968350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 216/448] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:46 2022] GET /identity/v3/groups/c8ecb613aa2e4f91a57228048bb2e9d2 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:46.974510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa1eea-bcdd-4285-95f0-03fc8bfe79b0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:47.024718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe107413-90d1-41d4-b14f-ba2739638842 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:47.063126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa92b3-4ea5-4666-9495-e17cebc3e125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:47.063763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa92b3-4ea5-4666-9495-e17cebc3e125 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:47.064036 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa92b3-4ea5-4666-9495-e17cebc3e125 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:47.064305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa92b3-4ea5-4666-9495-e17cebc3e125 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:47.066203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:47.078713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa92b3-4ea5-4666-9495-e17cebc3e125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-04aa92b3-4ea5-4666-9495-e17cebc3e125 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:47.084730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:47.085886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:58:47.086861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:47.087593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa1eea-bcdd-4285-95f0-03fc8bfe79b0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:47.092113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 233/449] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:58:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:47.093316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa92b3-4ea5-4666-9495-e17cebc3e125 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:47.128980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1f13e-ba66-4058-99f7-bdb0584b1816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:47.129582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1f13e-ba66-4058-99f7-bdb0584b1816 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:47.129967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1f13e-ba66-4058-99f7-bdb0584b1816 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:47.130233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1f13e-ba66-4058-99f7-bdb0584b1816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:47.130981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1f13e-ba66-4058-99f7-bdb0584b1816 None admin] RBAC: Adding query filter params (group.id=c8ecb613aa2e4f91a57228048bb2e9d2, role.id=b320236412e649d9ab1e6787ef8a6870, scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:47.131285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1f13e-ba66-4058-99f7-bdb0584b1816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:47.132722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1f13e-ba66-4058-99f7-bdb0584b1816 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:47.139149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 217/450] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 19 11:58:46 2022] GET /identity/v3/role_assignments?group.id=c8ecb613aa2e4f91a57228048bb2e9d2&scope.project.id=6996da8c3b0c4e7c8a54a1fc1b043b29&role.id=b320236412e649d9ab1e6787ef8a6870 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:47.196599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa92b3-4ea5-4666-9495-e17cebc3e125 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:47.233032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad1d07-dac7-421b-8ad9-6fd65d5dd733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:47.233675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad1d07-dac7-421b-8ad9-6fd65d5dd733 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:47.233959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad1d07-dac7-421b-8ad9-6fd65d5dd733 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:47.234231 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad1d07-dac7-421b-8ad9-6fd65d5dd733 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:47.234900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad1d07-dac7-421b-8ad9-6fd65d5dd733 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:47.235201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad1d07-dac7-421b-8ad9-6fd65d5dd733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:47.236589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad1d07-dac7-421b-8ad9-6fd65d5dd733 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:47.245433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 234/451] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:47.252338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1f13e-ba66-4058-99f7-bdb0584b1816 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:47.312538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:47.359293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1f13e-ba66-4058-99f7-bdb0584b1816 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:47.393183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e921334-dfdf-42e0-8035-fcb8842a075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:47.393833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e921334-dfdf-42e0-8035-fcb8842a075c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:47.394114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e921334-dfdf-42e0-8035-fcb8842a075c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:47.394386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e921334-dfdf-42e0-8035-fcb8842a075c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:47.460336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e921334-dfdf-42e0-8035-fcb8842a075c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:47.461812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e921334-dfdf-42e0-8035-fcb8842a075c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:47.515014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:47.559447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 218/452] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:47.565159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad1d07-dac7-421b-8ad9-6fd65d5dd733 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:47.622747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:47.666654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad1d07-dac7-421b-8ad9-6fd65d5dd733 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:47.700074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117e52-1d2d-452f-a402-c0563acce0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:47.700699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117e52-1d2d-452f-a402-c0563acce0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:47.700977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117e52-1d2d-452f-a402-c0563acce0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:47.701247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117e52-1d2d-452f-a402-c0563acce0d8 None admin] PATH_INFO: `/v3/projects/ae0bb369f1514f798528db70a760243b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:47.702373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70117e52-1d2d-452f-a402-c0563acce0d8 None admin] RBAC: Authorizing `identity:get_project(project_id=ae0bb369f1514f798528db70a760243b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:47.703793 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70117e52-1d2d-452f-a402-c0563acce0d8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:47.705670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 235/453] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 11:58:47 2022] GET /identity/v3/projects/ae0bb369f1514f798528db70a760243b => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:47.711187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e921334-dfdf-42e0-8035-fcb8842a075c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:47.805077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e921334-dfdf-42e0-8035-fcb8842a075c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:47.837045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5e836-7f54-4c94-a340-e93208374b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:47.837666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5e836-7f54-4c94-a340-e93208374b9a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:47.837943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5e836-7f54-4c94-a340-e93208374b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:47.838209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5e836-7f54-4c94-a340-e93208374b9a None admin] PATH_INFO: `/v3/groups/cb1ddfe8dfd5411fad90d1f5c43c805c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:47.839271 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5e836-7f54-4c94-a340-e93208374b9a None admin] RBAC: Authorizing `identity:get_group(group_id=cb1ddfe8dfd5411fad90d1f5c43c805c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:47.840772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5e836-7f54-4c94-a340-e93208374b9a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:47.842326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 219/454] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 19 11:58:47 2022] GET /identity/v3/groups/cb1ddfe8dfd5411fad90d1f5c43c805c => generated 229 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:47.848438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117e52-1d2d-452f-a402-c0563acce0d8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:47.945224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117e52-1d2d-452f-a402-c0563acce0d8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:47.966796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:47.982676 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae2f8c-e7da-4d1a-8a88-68e7c9882f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:47.983287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae2f8c-e7da-4d1a-8a88-68e7c9882f50 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:47.983567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae2f8c-e7da-4d1a-8a88-68e7c9882f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:47.983843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae2f8c-e7da-4d1a-8a88-68e7c9882f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:47.984557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae2f8c-e7da-4d1a-8a88-68e7c9882f50 None admin] RBAC: Adding query filter params (group.id=cb1ddfe8dfd5411fad90d1f5c43c805c, role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=ae0bb369f1514f798528db70a760243b) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:47.984864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae2f8c-e7da-4d1a-8a88-68e7c9882f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:47.986320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae2f8c-e7da-4d1a-8a88-68e7c9882f50 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:47.992086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 236/455] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 19 11:58:47 2022] GET /identity/v3/role_assignments?group.id=cb1ddfe8dfd5411fad90d1f5c43c805c&scope.project.id=ae0bb369f1514f798528db70a760243b&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:50.651419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb3ab6-dd76-44f7-b2ca-3c53570a6af8 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:50.652965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb3ab6-dd76-44f7-b2ca-3c53570a6af8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:50.653493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb3ab6-dd76-44f7-b2ca-3c53570a6af8 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:50.655345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 220/456] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:50.665791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0cded-54d1-4370-ad06-6c283b996e56 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:50.666710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0cded-54d1-4370-ad06-6c283b996e56 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:50.670459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0cded-54d1-4370-ad06-6c283b996e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:50.695046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-aad0cded-54d1-4370-ad06-6c283b996e56 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:50.696226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-aad0cded-54d1-4370-ad06-6c283b996e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:50.798268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 237/457] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:51.014868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523b6dc-4bbd-4af8-80fb-8fdf81814198 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.015072 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523b6dc-4bbd-4af8-80fb-8fdf81814198 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.015502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523b6dc-4bbd-4af8-80fb-8fdf81814198 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.016961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 221/458] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:51.026924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7282b27-dc44-44be-9152-77c79db24bb4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.027438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7282b27-dc44-44be-9152-77c79db24bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.027857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7282b27-dc44-44be-9152-77c79db24bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.034203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa725f-6408-42e5-91ae-6a3fa0a9976e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.034746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa725f-6408-42e5-91ae-6a3fa0a9976e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.035219 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa725f-6408-42e5-91ae-6a3fa0a9976e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.036969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 222/459] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:51.042392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c3435-d5fe-4df0-b50b-ae4b2b740e94 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.043428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c3435-d5fe-4df0-b50b-ae4b2b740e94 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.044137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c3435-d5fe-4df0-b50b-ae4b2b740e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.057971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d7282b27-dc44-44be-9152-77c79db24bb4 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:51.060229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d7282b27-dc44-44be-9152-77c79db24bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:51.063572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ce9c3435-d5fe-4df0-b50b-ae4b2b740e94 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:51.064961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ce9c3435-d5fe-4df0-b50b-ae4b2b740e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:51.089990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:51.154066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 223/460] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:51.173406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 238/461] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:51.210317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c3435-d5fe-4df0-b50b-ae4b2b740e94 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.307188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dcd36-37ef-4a82-9aff-3617e41c488e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.307805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dcd36-37ef-4a82-9aff-3617e41c488e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.308277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dcd36-37ef-4a82-9aff-3617e41c488e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.316676 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 239/462] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:51.322831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5105-04b9-40a6-b8c8-3bc34a24a10d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.323326 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5105-04b9-40a6-b8c8-3bc34a24a10d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.323813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5105-04b9-40a6-b8c8-3bc34a24a10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.355896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c3435-d5fe-4df0-b50b-ae4b2b740e94 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.357058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a0bf5105-04b9-40a6-b8c8-3bc34a24a10d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:51.358478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a0bf5105-04b9-40a6-b8c8-3bc34a24a10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:51.424046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeec3cd-d223-4a05-a10e-bf02876b5a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.425479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeec3cd-d223-4a05-a10e-bf02876b5a09 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.426939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeec3cd-d223-4a05-a10e-bf02876b5a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.428397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeec3cd-d223-4a05-a10e-bf02876b5a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.442126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:51.452690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeec3cd-d223-4a05-a10e-bf02876b5a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.454192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeec3cd-d223-4a05-a10e-bf02876b5a09 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:51.476259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 240/463] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:51.481994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5105-04b9-40a6-b8c8-3bc34a24a10d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4eeec3cd-d223-4a05-a10e-bf02876b5a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:51.482162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:51.482981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:51.483831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:51.483831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:51.483831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:51.483831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 224/464] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:51.491394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeec3cd-d223-4a05-a10e-bf02876b5a09 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.497611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:51.624841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5105-04b9-40a6-b8c8-3bc34a24a10d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.632804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeec3cd-d223-4a05-a10e-bf02876b5a09 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.665183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199ef81-18d2-4fc2-bc04-764001789c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.665852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199ef81-18d2-4fc2-bc04-764001789c86 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.666795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199ef81-18d2-4fc2-bc04-764001789c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.667431 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199ef81-18d2-4fc2-bc04-764001789c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.670252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5571bd-5032-4bb7-a2be-b4febd44f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.671312 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5571bd-5032-4bb7-a2be-b4febd44f320 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.671732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5571bd-5032-4bb7-a2be-b4febd44f320 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.672165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5571bd-5032-4bb7-a2be-b4febd44f320 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.673038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5571bd-5032-4bb7-a2be-b4febd44f320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:51.673477 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5571bd-5032-4bb7-a2be-b4febd44f320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.675038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5571bd-5032-4bb7-a2be-b4febd44f320 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:51.679955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199ef81-18d2-4fc2-bc04-764001789c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.681417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199ef81-18d2-4fc2-bc04-764001789c86 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:51.690047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 225/465] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:51.691128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5571bd-5032-4bb7-a2be-b4febd44f320 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3199ef81-18d2-4fc2-bc04-764001789c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:51.708347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:51.709264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:51.710713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:51.710713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:51.710713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:51.710713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 241/466] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:51.710713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199ef81-18d2-4fc2-bc04-764001789c86 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.748793 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:51.764635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:51.804958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5571bd-5032-4bb7-a2be-b4febd44f320 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.826357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199ef81-18d2-4fc2-bc04-764001789c86 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.840309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27cfc6-0e6c-40db-a0df-a44b83a0996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.841062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27cfc6-0e6c-40db-a0df-a44b83a0996f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.841335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27cfc6-0e6c-40db-a0df-a44b83a0996f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.841607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27cfc6-0e6c-40db-a0df-a44b83a0996f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.852453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27cfc6-0e6c-40db-a0df-a44b83a0996f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.853928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27cfc6-0e6c-40db-a0df-a44b83a0996f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:51.862427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510f790-9364-4665-b5c1-b3c4f0ed921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.863029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510f790-9364-4665-b5c1-b3c4f0ed921d None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.863303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510f790-9364-4665-b5c1-b3c4f0ed921d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.863572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510f790-9364-4665-b5c1-b3c4f0ed921d None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.864203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510f790-9364-4665-b5c1-b3c4f0ed921d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.865599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510f790-9364-4665-b5c1-b3c4f0ed921d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-9f27cfc6-0e6c-40db-a0df-a44b83a0996f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:51.868997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:51.869917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:51.870756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:51.870756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:51.870756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:51.870756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 226/467] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:51.871999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27cfc6-0e6c-40db-a0df-a44b83a0996f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.894420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 242/468] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:58:51 2022] POST /identity/v3/users => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:51.896168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510f790-9364-4665-b5c1-b3c4f0ed921d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.991596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27cfc6-0e6c-40db-a0df-a44b83a0996f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:52.011073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:52.022133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:52.033162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510f790-9364-4665-b5c1-b3c4f0ed921d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:52.035048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e641644-47ba-453b-9325-f735a927e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:52.035923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e641644-47ba-453b-9325-f735a927e691 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:52.036357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e641644-47ba-453b-9325-f735a927e691 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:52.036847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e641644-47ba-453b-9325-f735a927e691 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:52.037812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e641644-47ba-453b-9325-f735a927e691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:52.038333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e641644-47ba-453b-9325-f735a927e691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:52.039999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e641644-47ba-453b-9325-f735a927e691 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:52.058053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 227/469] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:52.059442 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e641644-47ba-453b-9325-f735a927e691 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:52.075541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec360c-27fa-4fa7-9470-2517eaf823a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:52.076238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec360c-27fa-4fa7-9470-2517eaf823a3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:52.076447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec360c-27fa-4fa7-9470-2517eaf823a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:52.076712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec360c-27fa-4fa7-9470-2517eaf823a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:52.088293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec360c-27fa-4fa7-9470-2517eaf823a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:52.090379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec360c-27fa-4fa7-9470-2517eaf823a3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3eec360c-27fa-4fa7-9470-2517eaf823a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:52.107029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:52.108004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:52.108833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:52.108833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:52.108833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:52.110553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 243/470] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:52.110553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec360c-27fa-4fa7-9470-2517eaf823a3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:52.183704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e641644-47ba-453b-9325-f735a927e691 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:52.218911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5989d9-b7f5-4dc6-87c4-da63fd98df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:52.219533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5989d9-b7f5-4dc6-87c4-da63fd98df8e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:52.219822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5989d9-b7f5-4dc6-87c4-da63fd98df8e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:52.220078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5989d9-b7f5-4dc6-87c4-da63fd98df8e None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:52.220723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5989d9-b7f5-4dc6-87c4-da63fd98df8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:52.221020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5989d9-b7f5-4dc6-87c4-da63fd98df8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:52.222435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5989d9-b7f5-4dc6-87c4-da63fd98df8e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:52.230335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec360c-27fa-4fa7-9470-2517eaf823a3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:52.235455 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 228/471] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:52.240194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5989d9-b7f5-4dc6-87c4-da63fd98df8e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:52.270310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f969b83-b081-405e-a910-b5fb89f34cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:52.271024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969b83-b081-405e-a910-b5fb89f34cdd None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:52.271300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969b83-b081-405e-a910-b5fb89f34cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:52.271570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969b83-b081-405e-a910-b5fb89f34cdd None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:52.272204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f969b83-b081-405e-a910-b5fb89f34cdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:52.273856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f969b83-b081-405e-a910-b5fb89f34cdd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:52.275081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:52.286542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:52.299761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 244/472] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:58:52 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:52.300986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3f88d-1869-4f91-9728-e4f5f8bde2c8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:52.301270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3f88d-1869-4f91-9728-e4f5f8bde2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:52.301544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3f88d-1869-4f91-9728-e4f5f8bde2c8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:52.302927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 245/473] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:52.303464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3f88d-1869-4f91-9728-e4f5f8bde2c8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:52.389913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5989d9-b7f5-4dc6-87c4-da63fd98df8e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:52.439298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4fcb-91d5-4906-bdcd-f4f48663f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:52.439633 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3f88d-1869-4f91-9728-e4f5f8bde2c8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:52.439835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4fcb-91d5-4906-bdcd-f4f48663f1fc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:52.440120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4fcb-91d5-4906-bdcd-f4f48663f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:52.440395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4fcb-91d5-4906-bdcd-f4f48663f1fc None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:52.441061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee4fcb-91d5-4906-bdcd-f4f48663f1fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:52.441706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee4fcb-91d5-4906-bdcd-f4f48663f1fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:52.444356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee4fcb-91d5-4906-bdcd-f4f48663f1fc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:52.462018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 229/474] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:52.463689 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0da89-a72f-477a-b69e-4f286f16c9f8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:52.463974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0da89-a72f-477a-b69e-4f286f16c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:52.464491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0da89-a72f-477a-b69e-4f286f16c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:52.487355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19773691-0a30-4b5d-8a4a-1ca460dc0505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:52.487965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773691-0a30-4b5d-8a4a-1ca460dc0505 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:52.488239 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773691-0a30-4b5d-8a4a-1ca460dc0505 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:52.488512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773691-0a30-4b5d-8a4a-1ca460dc0505 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:52.489153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19773691-0a30-4b5d-8a4a-1ca460dc0505 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:52.490685 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f1c0da89-a72f-477a-b69e-4f286f16c9f8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:52.490808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19773691-0a30-4b5d-8a4a-1ca460dc0505 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:52.491898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f1c0da89-a72f-477a-b69e-4f286f16c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:52.521119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 246/475] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:58:52 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:52.521973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19773691-0a30-4b5d-8a4a-1ca460dc0505 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:52.590493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:52.594187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 230/476] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:52.651436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19773691-0a30-4b5d-8a4a-1ca460dc0505 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:52.691121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e2a05-4e81-4fb4-92ce-db5c27bac047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:52.691730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e2a05-4e81-4fb4-92ce-db5c27bac047 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:52.691937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e2a05-4e81-4fb4-92ce-db5c27bac047 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:52.692215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e2a05-4e81-4fb4-92ce-db5c27bac047 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:52.692889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e2a05-4e81-4fb4-92ce-db5c27bac047 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:52.694388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e2a05-4e81-4fb4-92ce-db5c27bac047 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:52.733031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 247/477] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:58:52 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:52.893493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0da89-a72f-477a-b69e-4f286f16c9f8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:52.925695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:53.007275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0da89-a72f-477a-b69e-4f286f16c9f8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:53.044915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f25c3-a07d-4bb5-9e3d-72f7b189d1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:53.045799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f25c3-a07d-4bb5-9e3d-72f7b189d1da None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:53.046216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f25c3-a07d-4bb5-9e3d-72f7b189d1da None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:53.046629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f25c3-a07d-4bb5-9e3d-72f7b189d1da None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:53.047429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f25c3-a07d-4bb5-9e3d-72f7b189d1da None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:53.049011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f25c3-a07d-4bb5-9e3d-72f7b189d1da None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:53.059317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.sql.core [None req-074f25c3-a07d-4bb5-9e3d-72f7b189d1da None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:58:53.059317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 11:58:53.059317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [parameters: {'id': '6933764f5abc4be6bb886184c76b1c1a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 11:58:53.059317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-074f25c3-a07d-4bb5-9e3d-72f7b189d1da None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Sep 19 11:58:53.076875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return ref.to_dict() Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:58:53.077996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application yield resource Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise self.value Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application session.commit() Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:58:53.079109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:58:53.080012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:58:53.080848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:58:53.081647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [parameters: {'id': '6933764f5abc4be6bb886184c76b1c1a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:53.082573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 11:58:53.083478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:53.086041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 231/478] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Sep 19 11:58:52 2022] POST /identity/v3/roles => generated 144 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:53.092907 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e2a05-4e81-4fb4-92ce-db5c27bac047 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:53.211977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e2a05-4e81-4fb4-92ce-db5c27bac047 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:53.219658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:53.259214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0642522-92a0-4433-988b-f7c09018e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:53.260092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0642522-92a0-4433-988b-f7c09018e02a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:53.260510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0642522-92a0-4433-988b-f7c09018e02a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:53.260922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0642522-92a0-4433-988b-f7c09018e02a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:53.276787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0642522-92a0-4433-988b-f7c09018e02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e0642522-92a0-4433-988b-f7c09018e02a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:53.282145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:53.283152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:58:53.284103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:53.286402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 248/479] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:58:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:53.292329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f25c3-a07d-4bb5-9e3d-72f7b189d1da None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:53.407437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:53.415940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f25c3-a07d-4bb5-9e3d-72f7b189d1da None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:53.454512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ff7b0-e281-4ffa-888e-3c67066e8fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:53.455130 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff7b0-e281-4ffa-888e-3c67066e8fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:53.455410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff7b0-e281-4ffa-888e-3c67066e8fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:53.455682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff7b0-e281-4ffa-888e-3c67066e8fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:53.456347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ff7b0-e281-4ffa-888e-3c67066e8fc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:53.456791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ff7b0-e281-4ffa-888e-3c67066e8fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:53.458196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ff7b0-e281-4ffa-888e-3c67066e8fc1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:53.467574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 232/480] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:54.530032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25226b-f886-488d-a048-0c5be8676af0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:54.530922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25226b-f886-488d-a048-0c5be8676af0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:54.531352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25226b-f886-488d-a048-0c5be8676af0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:54.532840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 249/481] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:54.538447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b1e79-9455-42fd-a1ba-5b584a309683 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:54.538890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b1e79-9455-42fd-a1ba-5b584a309683 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:54.538996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b1e79-9455-42fd-a1ba-5b584a309683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:54.566681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0f2b1e79-9455-42fd-a1ba-5b584a309683 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:54.567890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0f2b1e79-9455-42fd-a1ba-5b584a309683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:54.662707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 233/482] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:55.034093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25226b-f886-488d-a048-0c5be8676af0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:55.166553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25226b-f886-488d-a048-0c5be8676af0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:55.211349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbe332-0ef8-49bc-9253-c2659b05cd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:55.212331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbe332-0ef8-49bc-9253-c2659b05cd67 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:55.212801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbe332-0ef8-49bc-9253-c2659b05cd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:55.213342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbe332-0ef8-49bc-9253-c2659b05cd67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:55.234270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbe332-0ef8-49bc-9253-c2659b05cd67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8ebbe332-0ef8-49bc-9253-c2659b05cd67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:55.239416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:55.240263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:58:55.241044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:55.243310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 250/483] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:58:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:55.249430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b1e79-9455-42fd-a1ba-5b584a309683 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:55.264734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162dde6-a112-4805-81ae-197c01095401 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:55.265321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162dde6-a112-4805-81ae-197c01095401 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:55.265829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162dde6-a112-4805-81ae-197c01095401 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:55.267699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 251/484] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:58:55.272705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28656a8-2331-4060-9849-686e2c70f486 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:55.273209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28656a8-2331-4060-9849-686e2c70f486 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:55.273699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28656a8-2331-4060-9849-686e2c70f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:55.295663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b28656a8-2331-4060-9849-686e2c70f486 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:55.297134 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b28656a8-2331-4060-9849-686e2c70f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:55.320259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:55.360322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:55.376844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 252/485] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:58:55.378138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c846fe1-6a5f-42b6-8ca6-6d4e7570596d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:55.378420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c846fe1-6a5f-42b6-8ca6-6d4e7570596d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:55.378692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c846fe1-6a5f-42b6-8ca6-6d4e7570596d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:55.380136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 253/486] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:55.385393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b330a-eda7-4e26-8286-d01f4ff5dab4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:55.385836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b330a-eda7-4e26-8286-d01f4ff5dab4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:55.386116 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b330a-eda7-4e26-8286-d01f4ff5dab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:55.389833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b1e79-9455-42fd-a1ba-5b584a309683 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:55.419110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9c7b330a-eda7-4e26-8286-d01f4ff5dab4 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:55.420296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9c7b330a-eda7-4e26-8286-d01f4ff5dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:55.469231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3fc41-d1ae-4226-ad95-77c64600310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:55.470217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3fc41-d1ae-4226-ad95-77c64600310d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:55.470708 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3fc41-d1ae-4226-ad95-77c64600310d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:55.471184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3fc41-d1ae-4226-ad95-77c64600310d None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:55.472044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3fc41-d1ae-4226-ad95-77c64600310d None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:55.472535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3fc41-d1ae-4226-ad95-77c64600310d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:55.474398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3fc41-d1ae-4226-ad95-77c64600310d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:55.483599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 234/487] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:58:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:55.485206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4111ee-2dc9-4b03-bc84-700deaaad0d9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:55.485728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4111ee-2dc9-4b03-bc84-700deaaad0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:55.486282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4111ee-2dc9-4b03-bc84-700deaaad0d9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:55.487963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 235/488] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:55.493853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4111ee-2dc9-4b03-bc84-700deaaad0d9 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:55.504954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 254/489] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:55.506545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9f63a-b0b6-46b4-ab36-2b854d21a2c0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:55.507045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9f63a-b0b6-46b4-ab36-2b854d21a2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:55.507491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9f63a-b0b6-46b4-ab36-2b854d21a2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:55.527434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e6d9f63a-b0b6-46b4-ab36-2b854d21a2c0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:55.528936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e6d9f63a-b0b6-46b4-ab36-2b854d21a2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:55.630754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 255/490] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:55.670194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9f63a-b0b6-46b4-ab36-2b854d21a2c0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:55.701772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:55.709795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4111ee-2dc9-4b03-bc84-700deaaad0d9 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:55.773977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d902-b02c-4d50-9994-3b9c475c2e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:55.774601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d902-b02c-4d50-9994-3b9c475c2e47 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:55.774882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d902-b02c-4d50-9994-3b9c475c2e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:55.775155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d902-b02c-4d50-9994-3b9c475c2e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:55.800012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4d902-b02c-4d50-9994-3b9c475c2e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:55.801478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4d902-b02c-4d50-9994-3b9c475c2e47 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:55.805787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6af4d902-b02c-4d50-9994-3b9c475c2e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:55.825382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:55.826396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:55.827229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:55.827229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:55.827229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:55.827229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 236/491] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:58:55.833792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d902-b02c-4d50-9994-3b9c475c2e47 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:55.848622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9f63a-b0b6-46b4-ab36-2b854d21a2c0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:55.895614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c4415-c473-4f1f-8591-a8b29179185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:55.897053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c4415-c473-4f1f-8591-a8b29179185c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:55.897537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c4415-c473-4f1f-8591-a8b29179185c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:55.898077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c4415-c473-4f1f-8591-a8b29179185c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:55.913951 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c4415-c473-4f1f-8591-a8b29179185c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-860c4415-c473-4f1f-8591-a8b29179185c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:55.921766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:55.922651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:58:55.923415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:55.926925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 256/492] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:58:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:55.928323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c4415-c473-4f1f-8591-a8b29179185c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:55.964765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d902-b02c-4d50-9994-3b9c475c2e47 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.006492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26927e71-9b48-4857-88fe-0ecc06061935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.007097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26927e71-9b48-4857-88fe-0ecc06061935 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.007375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26927e71-9b48-4857-88fe-0ecc06061935 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.007644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26927e71-9b48-4857-88fe-0ecc06061935 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.008439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26927e71-9b48-4857-88fe-0ecc06061935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:56.008743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26927e71-9b48-4857-88fe-0ecc06061935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:56.010911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26927e71-9b48-4857-88fe-0ecc06061935 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:56.021030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:56.029230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 237/493] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:56.029230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26927e71-9b48-4857-88fe-0ecc06061935 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.051296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c4415-c473-4f1f-8591-a8b29179185c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.083313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:56.088814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631652b-3ee1-4c0a-b734-94832b9516f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.089452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631652b-3ee1-4c0a-b734-94832b9516f1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.089916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631652b-3ee1-4c0a-b734-94832b9516f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.090532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631652b-3ee1-4c0a-b734-94832b9516f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.101795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631652b-3ee1-4c0a-b734-94832b9516f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6631652b-3ee1-4c0a-b734-94832b9516f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:56.107069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:56.107948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:56.108725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 257/494] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:58:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:56.109376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631652b-3ee1-4c0a-b734-94832b9516f1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.141770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26927e71-9b48-4857-88fe-0ecc06061935 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.182225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031e56f-abfe-4c79-81e5-b8527a4536ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.182748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031e56f-abfe-4c79-81e5-b8527a4536ce None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.183022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031e56f-abfe-4c79-81e5-b8527a4536ce None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.183325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031e56f-abfe-4c79-81e5-b8527a4536ce None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.184662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031e56f-abfe-4c79-81e5-b8527a4536ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:56.184967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031e56f-abfe-4c79-81e5-b8527a4536ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:56.186786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031e56f-abfe-4c79-81e5-b8527a4536ce None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:56.196682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 238/495] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:56.199242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031e56f-abfe-4c79-81e5-b8527a4536ce None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.211302 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631652b-3ee1-4c0a-b734-94832b9516f1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.250328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280712b-db54-4b6b-9858-f9362484ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.250956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280712b-db54-4b6b-9858-f9362484ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.251234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280712b-db54-4b6b-9858-f9362484ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.251501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280712b-db54-4b6b-9858-f9362484ffd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.254292 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:56.263260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280712b-db54-4b6b-9858-f9362484ffd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1280712b-db54-4b6b-9858-f9362484ffd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:58:56.268330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:56.269194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 258/496] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:56.270630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280712b-db54-4b6b-9858-f9362484ffd8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.306368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031e56f-abfe-4c79-81e5-b8527a4536ce None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.323640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:56.341654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac5103-0d53-4837-a803-2e927cdff929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.342398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac5103-0d53-4837-a803-2e927cdff929 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.342684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac5103-0d53-4837-a803-2e927cdff929 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.342956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac5103-0d53-4837-a803-2e927cdff929 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.351507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac5103-0d53-4837-a803-2e927cdff929 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:56.353019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac5103-0d53-4837-a803-2e927cdff929 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e1ac5103-0d53-4837-a803-2e927cdff929 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:58:56.367323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:56.368491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:56.369572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:56.369572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:56.369572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:58:56.369572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:58:56.369572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:58:56.369572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:58:56.369572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:58:56.369572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:58:56.369572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:58:56.369572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:56.374025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 239/497] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:56.375011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac5103-0d53-4837-a803-2e927cdff929 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.384690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280712b-db54-4b6b-9858-f9362484ffd8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.425353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9afe1-d6f5-4692-9392-0d033bca349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.426376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9afe1-d6f5-4692-9392-0d033bca349f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.426937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9afe1-d6f5-4692-9392-0d033bca349f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.427379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9afe1-d6f5-4692-9392-0d033bca349f None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.428234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9afe1-d6f5-4692-9392-0d033bca349f None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:56.428709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9afe1-d6f5-4692-9392-0d033bca349f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:56.430410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9afe1-d6f5-4692-9392-0d033bca349f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:56.440878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 259/498] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:56.442029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9afe1-d6f5-4692-9392-0d033bca349f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.482495 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac5103-0d53-4837-a803-2e927cdff929 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.502981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:56.515441 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5dc49-444c-49de-8122-005686fcf943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.516068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5dc49-444c-49de-8122-005686fcf943 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.516351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5dc49-444c-49de-8122-005686fcf943 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.516624 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5dc49-444c-49de-8122-005686fcf943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.526905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5dc49-444c-49de-8122-005686fcf943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:56.528900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5dc49-444c-49de-8122-005686fcf943 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0ca5dc49-444c-49de-8122-005686fcf943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:56.542482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:56.543934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:56.544738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:56.544738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:56.544738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:56.544904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9afe1-d6f5-4692-9392-0d033bca349f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.544973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 240/499] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:56.545314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5dc49-444c-49de-8122-005686fcf943 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.578250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899922e1-2d0e-418f-8773-599810878a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.578762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:56.578878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899922e1-2d0e-418f-8773-599810878a08 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.579118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899922e1-2d0e-418f-8773-599810878a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.579391 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899922e1-2d0e-418f-8773-599810878a08 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.580050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899922e1-2d0e-418f-8773-599810878a08 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:56.580379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899922e1-2d0e-418f-8773-599810878a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:56.581745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899922e1-2d0e-418f-8773-599810878a08 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:56.589413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 260/500] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:56.590897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899922e1-2d0e-418f-8773-599810878a08 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.650822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5dc49-444c-49de-8122-005686fcf943 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.685312 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73376029-1247-4295-bd45-18b94717a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.685969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73376029-1247-4295-bd45-18b94717a04c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.686248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73376029-1247-4295-bd45-18b94717a04c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.686517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73376029-1247-4295-bd45-18b94717a04c None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.686783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899922e1-2d0e-418f-8773-599810878a08 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.687234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73376029-1247-4295-bd45-18b94717a04c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:56.687538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73376029-1247-4295-bd45-18b94717a04c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:56.688962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73376029-1247-4295-bd45-18b94717a04c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:56.705702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:56.721021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879e075-2bef-46c2-975a-a2ec268dda40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.721744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e075-2bef-46c2-975a-a2ec268dda40 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.722024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e075-2bef-46c2-975a-a2ec268dda40 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.722297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e075-2bef-46c2-975a-a2ec268dda40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.725418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 241/501] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:56.726684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41319a-128c-4dcf-91c3-87a2d91f44c6 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.726970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41319a-128c-4dcf-91c3-87a2d91f44c6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.727244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41319a-128c-4dcf-91c3-87a2d91f44c6 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.732792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 242/502] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:58:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:58:56.732792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41319a-128c-4dcf-91c3-87a2d91f44c6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.736466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879e075-2bef-46c2-975a-a2ec268dda40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:56.737942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879e075-2bef-46c2-975a-a2ec268dda40 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2879e075-2bef-46c2-975a-a2ec268dda40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:56.752256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:56.753240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:56.754124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:56.754124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:56.754124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:56.754124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 261/503] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:56.754124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879e075-2bef-46c2-975a-a2ec268dda40 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.818772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:56.832553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41319a-128c-4dcf-91c3-87a2d91f44c6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.854029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879e075-2bef-46c2-975a-a2ec268dda40 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:56.867686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e25b1-ac44-4ca1-a318-636df2d51fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.868285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e25b1-ac44-4ca1-a318-636df2d51fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.868569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e25b1-ac44-4ca1-a318-636df2d51fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.868844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e25b1-ac44-4ca1-a318-636df2d51fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.869481 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e25b1-ac44-4ca1-a318-636df2d51fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:56.869827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e25b1-ac44-4ca1-a318-636df2d51fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:56.871475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e25b1-ac44-4ca1-a318-636df2d51fc9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:56.882291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 243/504] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:56.883106 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e25b1-ac44-4ca1-a318-636df2d51fc9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:56.891594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2850e-b582-4b9d-8343-70661b9a0200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:56.892228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2850e-b582-4b9d-8343-70661b9a0200 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.892511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2850e-b582-4b9d-8343-70661b9a0200 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.892785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2850e-b582-4b9d-8343-70661b9a0200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.904541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2850e-b582-4b9d-8343-70661b9a0200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:56.906117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2850e-b582-4b9d-8343-70661b9a0200 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b9f2850e-b582-4b9d-8343-70661b9a0200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:56.920622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:56.921704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:56.922545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:56.922545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:56.922545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:56.922545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 262/505] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:56.923105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e194f10-8cd7-4377-90ba-d8fc66cd7b82 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:56.923385 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e194f10-8cd7-4377-90ba-d8fc66cd7b82 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:56.923659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e194f10-8cd7-4377-90ba-d8fc66cd7b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:56.941552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2e194f10-8cd7-4377-90ba-d8fc66cd7b82 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:56.942760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2e194f10-8cd7-4377-90ba-d8fc66cd7b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:56.959961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:56.987341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e25b1-ac44-4ca1-a318-636df2d51fc9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.008395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 263/506] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:57.009243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e194f10-8cd7-4377-90ba-d8fc66cd7b82 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.038881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba80e3-6340-4195-bdf3-0986f0c263a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.039714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba80e3-6340-4195-bdf3-0986f0c263a3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.040344 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba80e3-6340-4195-bdf3-0986f0c263a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.040944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba80e3-6340-4195-bdf3-0986f0c263a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.059762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:57.114654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e194f10-8cd7-4377-90ba-d8fc66cd7b82 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.118919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba80e3-6340-4195-bdf3-0986f0c263a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.120374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba80e3-6340-4195-bdf3-0986f0c263a3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.151948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702405-ecac-4060-82aa-99aa85f5028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.152700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702405-ecac-4060-82aa-99aa85f5028c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.153049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702405-ecac-4060-82aa-99aa85f5028c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.153388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702405-ecac-4060-82aa-99aa85f5028c None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.154128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a702405-ecac-4060-82aa-99aa85f5028c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:57.154492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a702405-ecac-4060-82aa-99aa85f5028c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.155958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a702405-ecac-4060-82aa-99aa85f5028c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.179278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 264/507] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:57.179278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702405-ecac-4060-82aa-99aa85f5028c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.194349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:57.236543 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 244/508] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:57.237426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba80e3-6340-4195-bdf3-0986f0c263a3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.288332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702405-ecac-4060-82aa-99aa85f5028c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.292563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:57.329069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be53c8-e30b-4ff9-a4fe-40126264bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.329729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be53c8-e30b-4ff9-a4fe-40126264bf83 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.330014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be53c8-e30b-4ff9-a4fe-40126264bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.330290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be53c8-e30b-4ff9-a4fe-40126264bf83 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.338068 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be53c8-e30b-4ff9-a4fe-40126264bf83 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.340049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be53c8-e30b-4ff9-a4fe-40126264bf83 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.347451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba80e3-6340-4195-bdf3-0986f0c263a3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-20be53c8-e30b-4ff9-a4fe-40126264bf83 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:58:57.353271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:57.354347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 265/509] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:57.356145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be53c8-e30b-4ff9-a4fe-40126264bf83 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.383973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a4830-8be1-4d65-86b5-5bbc29f40120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.384580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a4830-8be1-4d65-86b5-5bbc29f40120 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.384858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a4830-8be1-4d65-86b5-5bbc29f40120 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.385132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a4830-8be1-4d65-86b5-5bbc29f40120 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.385795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a4830-8be1-4d65-86b5-5bbc29f40120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:57.386104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a4830-8be1-4d65-86b5-5bbc29f40120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.387605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a4830-8be1-4d65-86b5-5bbc29f40120 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.398521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 245/510] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:57.399301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a4830-8be1-4d65-86b5-5bbc29f40120 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.432345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:57.456928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be53c8-e30b-4ff9-a4fe-40126264bf83 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.490446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93de358-6058-4190-ba6c-37f7d5017696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.490994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93de358-6058-4190-ba6c-37f7d5017696 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.491268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93de358-6058-4190-ba6c-37f7d5017696 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.491536 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93de358-6058-4190-ba6c-37f7d5017696 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.498807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93de358-6058-4190-ba6c-37f7d5017696 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.499115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a4830-8be1-4d65-86b5-5bbc29f40120 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.500519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93de358-6058-4190-ba6c-37f7d5017696 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.507613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b93de358-6058-4190-ba6c-37f7d5017696 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:58:57.512589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:57.513650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 266/511] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:57.519508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93de358-6058-4190-ba6c-37f7d5017696 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.533906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bb749-3373-450f-b89d-f9ef0d6cdd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.534542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bb749-3373-450f-b89d-f9ef0d6cdd43 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.534826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bb749-3373-450f-b89d-f9ef0d6cdd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.535102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bb749-3373-450f-b89d-f9ef0d6cdd43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.545868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3bb749-3373-450f-b89d-f9ef0d6cdd43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.547307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3bb749-3373-450f-b89d-f9ef0d6cdd43 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6c3bb749-3373-450f-b89d-f9ef0d6cdd43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:57.561357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:57.562410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:57.563856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:57.563856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:57.563856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:57.563856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 246/512] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:57.563856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bb749-3373-450f-b89d-f9ef0d6cdd43 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.613568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93de358-6058-4190-ba6c-37f7d5017696 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.646897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2dd05-ff41-4fc5-a5ec-f6dffefb18ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.647514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2dd05-ff41-4fc5-a5ec-f6dffefb18ff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.647811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2dd05-ff41-4fc5-a5ec-f6dffefb18ff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.648075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2dd05-ff41-4fc5-a5ec-f6dffefb18ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.650041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:57.662794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2dd05-ff41-4fc5-a5ec-f6dffefb18ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.664265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2dd05-ff41-4fc5-a5ec-f6dffefb18ff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.667507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bb749-3373-450f-b89d-f9ef0d6cdd43 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c2f2dd05-ff41-4fc5-a5ec-f6dffefb18ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:57.680955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:57.681879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:57.682689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:57.682689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:57.682689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:57.682689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 267/513] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:57.682903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2dd05-ff41-4fc5-a5ec-f6dffefb18ff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.703527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5529c90-669e-440a-8990-7f32f38a44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.704152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5529c90-669e-440a-8990-7f32f38a44db None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.704430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5529c90-669e-440a-8990-7f32f38a44db None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.704696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5529c90-669e-440a-8990-7f32f38a44db None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.705408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5529c90-669e-440a-8990-7f32f38a44db None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:57.705739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5529c90-669e-440a-8990-7f32f38a44db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.707444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5529c90-669e-440a-8990-7f32f38a44db None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.725058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 247/514] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:57.726078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5529c90-669e-440a-8990-7f32f38a44db None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.745062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:57.784222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2dd05-ff41-4fc5-a5ec-f6dffefb18ff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.817601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c696d2-efb2-4537-a874-a069173d3cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.818244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c696d2-efb2-4537-a874-a069173d3cbd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.818521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c696d2-efb2-4537-a874-a069173d3cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.818790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c696d2-efb2-4537-a874-a069173d3cbd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.824914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5529c90-669e-440a-8990-7f32f38a44db None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.826485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c696d2-efb2-4537-a874-a069173d3cbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.827914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c696d2-efb2-4537-a874-a069173d3cbd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-32c696d2-efb2-4537-a874-a069173d3cbd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:58:57.839064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:57.840884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 268/515] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:57.841835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c696d2-efb2-4537-a874-a069173d3cbd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.862928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6da61-6b2a-48c5-84a1-d746f5573b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.863527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6da61-6b2a-48c5-84a1-d746f5573b24 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.863807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6da61-6b2a-48c5-84a1-d746f5573b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.864084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6da61-6b2a-48c5-84a1-d746f5573b24 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.864798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6da61-6b2a-48c5-84a1-d746f5573b24 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:57.865102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6da61-6b2a-48c5-84a1-d746f5573b24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.866568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6da61-6b2a-48c5-84a1-d746f5573b24 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.884358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 248/516] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:57.885145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6da61-6b2a-48c5-84a1-d746f5573b24 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:57.892428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:57.947824 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c696d2-efb2-4537-a874-a069173d3cbd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.961116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:57.981458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290393e2-ceb7-4486-ac84-b93da56dea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:57.982083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290393e2-ceb7-4486-ac84-b93da56dea10 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:57.982356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290393e2-ceb7-4486-ac84-b93da56dea10 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:57.982622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290393e2-ceb7-4486-ac84-b93da56dea10 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:57.983247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290393e2-ceb7-4486-ac84-b93da56dea10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:57.983544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290393e2-ceb7-4486-ac84-b93da56dea10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:57.984816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6da61-6b2a-48c5-84a1-d746f5573b24 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:57.984906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290393e2-ceb7-4486-ac84-b93da56dea10 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:57.996767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 269/517] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:57.997446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290393e2-ceb7-4486-ac84-b93da56dea10 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:58.022246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a45e08-7b60-4cec-a7e7-81498de427df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:58.022849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a45e08-7b60-4cec-a7e7-81498de427df None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:58.023120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a45e08-7b60-4cec-a7e7-81498de427df None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:58.023395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a45e08-7b60-4cec-a7e7-81498de427df None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:58.024029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a45e08-7b60-4cec-a7e7-81498de427df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:58.024333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a45e08-7b60-4cec-a7e7-81498de427df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:58.025711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a45e08-7b60-4cec-a7e7-81498de427df None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:58.037772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 249/518] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:58.039067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a45e08-7b60-4cec-a7e7-81498de427df None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:58.096811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290393e2-ceb7-4486-ac84-b93da56dea10 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:58.104147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:58.132578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef44971-5aa6-472a-99b7-d3c8cd93d240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:58.133192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef44971-5aa6-472a-99b7-d3c8cd93d240 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:58.133468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef44971-5aa6-472a-99b7-d3c8cd93d240 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:58.133780 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef44971-5aa6-472a-99b7-d3c8cd93d240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:58.136327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a45e08-7b60-4cec-a7e7-81498de427df None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:58.169077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a057a53-f5db-4ed4-8c5f-bdbb250c75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:58.169703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a057a53-f5db-4ed4-8c5f-bdbb250c75f4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:58.169986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a057a53-f5db-4ed4-8c5f-bdbb250c75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:58.170257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a057a53-f5db-4ed4-8c5f-bdbb250c75f4 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:58.170970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a057a53-f5db-4ed4-8c5f-bdbb250c75f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:58.171276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a057a53-f5db-4ed4-8c5f-bdbb250c75f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:58.172692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a057a53-f5db-4ed4-8c5f-bdbb250c75f4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:58.175165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:58.190787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 250/519] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 19 11:58:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:58.191576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a057a53-f5db-4ed4-8c5f-bdbb250c75f4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:58.200730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef44971-5aa6-472a-99b7-d3c8cd93d240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:58.202214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef44971-5aa6-472a-99b7-d3c8cd93d240 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:58.290049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a057a53-f5db-4ed4-8c5f-bdbb250c75f4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:58.299116 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 270/520] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:58.299938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef44971-5aa6-472a-99b7-d3c8cd93d240 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:58.308358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:58.324731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef143475-705b-4aa6-ab2a-ba101b2eb989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:58.325327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef143475-705b-4aa6-ab2a-ba101b2eb989 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:58.325602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef143475-705b-4aa6-ab2a-ba101b2eb989 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:58.325964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef143475-705b-4aa6-ab2a-ba101b2eb989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:58.385966 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:58.393862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef143475-705b-4aa6-ab2a-ba101b2eb989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:58.395457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef143475-705b-4aa6-ab2a-ba101b2eb989 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:58.399244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef44971-5aa6-472a-99b7-d3c8cd93d240 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:58.432844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55813e2c-e2cc-484e-97f7-9f8ad7370a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:58.434140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55813e2c-e2cc-484e-97f7-9f8ad7370a5a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:58.434457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55813e2c-e2cc-484e-97f7-9f8ad7370a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:58.434722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55813e2c-e2cc-484e-97f7-9f8ad7370a5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:58.441410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55813e2c-e2cc-484e-97f7-9f8ad7370a5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:58.442882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55813e2c-e2cc-484e-97f7-9f8ad7370a5a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-55813e2c-e2cc-484e-97f7-9f8ad7370a5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:58:58.454592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:58.455593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:58.456599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:58:58.456599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:58:58.456599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:58:58.456599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:58:58.456599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:58:58.456599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:58:58.456599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:58:58.456599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:58.456599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 271/521] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:58.457132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55813e2c-e2cc-484e-97f7-9f8ad7370a5a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:58.492156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 251/522] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:58.492990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef143475-705b-4aa6-ab2a-ba101b2eb989 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:58.521011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:58.556462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55813e2c-e2cc-484e-97f7-9f8ad7370a5a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:58.582670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:58.589113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f50ca-6ad9-464c-8cdf-ffbe069e5c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:58.589987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f50ca-6ad9-464c-8cdf-ffbe069e5c9b None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:58.590160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef143475-705b-4aa6-ab2a-ba101b2eb989 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:58.590256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f50ca-6ad9-464c-8cdf-ffbe069e5c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:58.590522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f50ca-6ad9-464c-8cdf-ffbe069e5c9b None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:58.591155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f50ca-6ad9-464c-8cdf-ffbe069e5c9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:58.592568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f50ca-6ad9-464c-8cdf-ffbe069e5c9b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:58.614791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 272/523] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:58:58 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:58.615597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f50ca-6ad9-464c-8cdf-ffbe069e5c9b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:58.646921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d62e8-1583-4b0d-8b8f-c85abc293082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:58.647600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d62e8-1583-4b0d-8b8f-c85abc293082 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:58.647880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d62e8-1583-4b0d-8b8f-c85abc293082 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:58.648162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d62e8-1583-4b0d-8b8f-c85abc293082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:58.734245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d62e8-1583-4b0d-8b8f-c85abc293082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:58.735742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d62e8-1583-4b0d-8b8f-c85abc293082 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:58.735844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f50ca-6ad9-464c-8cdf-ffbe069e5c9b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:58.762776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:58.776532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d33147-95e8-4149-8636-bd1d62b823d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:58.777811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d33147-95e8-4149-8636-bd1d62b823d6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:58.778261 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d33147-95e8-4149-8636-bd1d62b823d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:58.778617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d33147-95e8-4149-8636-bd1d62b823d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:58.791376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d33147-95e8-4149-8636-bd1d62b823d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:58.793389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d33147-95e8-4149-8636-bd1d62b823d6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-84d33147-95e8-4149-8636-bd1d62b823d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:58.810147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:58.811069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:58.812100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:58.812100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:58.812100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:58.812100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 273/524] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:58.812100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d33147-95e8-4149-8636-bd1d62b823d6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:58.849929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:58.859131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 252/525] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:58.860009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d62e8-1583-4b0d-8b8f-c85abc293082 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:58.923492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d33147-95e8-4149-8636-bd1d62b823d6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:58.960221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cc7b2-4b0a-43a3-9e23-e8400d88d4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:58.960969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc7b2-4b0a-43a3-9e23-e8400d88d4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:58.961243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc7b2-4b0a-43a3-9e23-e8400d88d4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:58.961510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc7b2-4b0a-43a3-9e23-e8400d88d4b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:58.962224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cc7b2-4b0a-43a3-9e23-e8400d88d4b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:58.962461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d62e8-1583-4b0d-8b8f-c85abc293082 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:58.962560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cc7b2-4b0a-43a3-9e23-e8400d88d4b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:58.964188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cc7b2-4b0a-43a3-9e23-e8400d88d4b0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:58.987121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 274/526] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:58:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:58.988295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cc7b2-4b0a-43a3-9e23-e8400d88d4b0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.004531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1e91-ee97-4a0f-afee-14b3fb7b1926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.005173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1e91-ee97-4a0f-afee-14b3fb7b1926 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.005448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1e91-ee97-4a0f-afee-14b3fb7b1926 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.005749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1e91-ee97-4a0f-afee-14b3fb7b1926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.016493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae1e91-ee97-4a0f-afee-14b3fb7b1926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.017963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae1e91-ee97-4a0f-afee-14b3fb7b1926 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.025654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4cae1e91-ee97-4a0f-afee-14b3fb7b1926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:59.034377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:59.035320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:59.041237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:59.041237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:59.041237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:59.041237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 253/527] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:59.041237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1e91-ee97-4a0f-afee-14b3fb7b1926 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.082842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:59.107540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cc7b2-4b0a-43a3-9e23-e8400d88d4b0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:59.141589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1e91-ee97-4a0f-afee-14b3fb7b1926 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:59.141799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf5a91-c97a-400c-aeff-52b57841c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.142368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf5a91-c97a-400c-aeff-52b57841c68b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.142643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf5a91-c97a-400c-aeff-52b57841c68b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.142913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf5a91-c97a-400c-aeff-52b57841c68b None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.143543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf5a91-c97a-400c-aeff-52b57841c68b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:59.143829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf5a91-c97a-400c-aeff-52b57841c68b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.145208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf5a91-c97a-400c-aeff-52b57841c68b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.157480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 275/528] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:59.158307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf5a91-c97a-400c-aeff-52b57841c68b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.181924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f2369-e0b8-4352-871c-1e956ba93c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.182935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f2369-e0b8-4352-871c-1e956ba93c11 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.183567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f2369-e0b8-4352-871c-1e956ba93c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.183842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f2369-e0b8-4352-871c-1e956ba93c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.195146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f2369-e0b8-4352-871c-1e956ba93c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.196657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f2369-e0b8-4352-871c-1e956ba93c11 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5f1f2369-e0b8-4352-871c-1e956ba93c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:58:59.212518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:59.213392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:58:59.214254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:58:59.214254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:58:59.214254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:58:59.214254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 254/529] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:59.215298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f2369-e0b8-4352-871c-1e956ba93c11 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.261925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:59.269796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf5a91-c97a-400c-aeff-52b57841c68b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:59.307033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4eaaf-c173-456f-8d4d-4f3189968d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.307638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4eaaf-c173-456f-8d4d-4f3189968d98 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.307954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4eaaf-c173-456f-8d4d-4f3189968d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.308248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4eaaf-c173-456f-8d4d-4f3189968d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.309553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4eaaf-c173-456f-8d4d-4f3189968d98 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=02430b0097f94fa0a2015480a6ec68eb) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:59.309888 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4eaaf-c173-456f-8d4d-4f3189968d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.311303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4eaaf-c173-456f-8d4d-4f3189968d98 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.321761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 276/530] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/role_assignments?user.id=02430b0097f94fa0a2015480a6ec68eb&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:59.321761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4eaaf-c173-456f-8d4d-4f3189968d98 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.337230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:59.342520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f2369-e0b8-4352-871c-1e956ba93c11 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:59.386742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631bc6-d88f-417e-be48-df107a82065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.387374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631bc6-d88f-417e-be48-df107a82065b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.387653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631bc6-d88f-417e-be48-df107a82065b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.387925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631bc6-d88f-417e-be48-df107a82065b None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.388789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631bc6-d88f-417e-be48-df107a82065b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:59.389592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631bc6-d88f-417e-be48-df107a82065b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.391434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631bc6-d88f-417e-be48-df107a82065b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.413929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 255/531] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:59.415948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631bc6-d88f-417e-be48-df107a82065b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.466375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4eaaf-c173-456f-8d4d-4f3189968d98 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:59.519754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421e85-f7fb-4af3-b5c4-3913aada2588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.520707 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421e85-f7fb-4af3-b5c4-3913aada2588 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.521161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421e85-f7fb-4af3-b5c4-3913aada2588 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.522159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421e85-f7fb-4af3-b5c4-3913aada2588 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.531557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11421e85-f7fb-4af3-b5c4-3913aada2588 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.534080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11421e85-f7fb-4af3-b5c4-3913aada2588 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.547913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631bc6-d88f-417e-be48-df107a82065b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-11421e85-f7fb-4af3-b5c4-3913aada2588 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:58:59.548551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:59.549370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:59.550233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:58:59.550233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:58:59.550233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:58:59.550233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:58:59.550233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:58:59.550233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:58:59.550233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:58:59.550233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:59.553535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 277/532] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:59.554756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421e85-f7fb-4af3-b5c4-3913aada2588 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.581311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:59.591655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caba895-a3c2-4be8-bc96-9991efc6a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.592520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caba895-a3c2-4be8-bc96-9991efc6a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.592940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caba895-a3c2-4be8-bc96-9991efc6a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.593394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caba895-a3c2-4be8-bc96-9991efc6a7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.594323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caba895-a3c2-4be8-bc96-9991efc6a7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:59.594763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caba895-a3c2-4be8-bc96-9991efc6a7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.596328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caba895-a3c2-4be8-bc96-9991efc6a7e9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.613924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 256/533] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:59.614985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caba895-a3c2-4be8-bc96-9991efc6a7e9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.634917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:59.679480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421e85-f7fb-4af3-b5c4-3913aada2588 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:59.718260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749a3a6-5107-4def-8d1e-61e73dbe6d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.719012 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749a3a6-5107-4def-8d1e-61e73dbe6d6b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.719391 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749a3a6-5107-4def-8d1e-61e73dbe6d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.719757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749a3a6-5107-4def-8d1e-61e73dbe6d6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.724660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caba895-a3c2-4be8-bc96-9991efc6a7e9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:59.727852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749a3a6-5107-4def-8d1e-61e73dbe6d6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.729299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749a3a6-5107-4def-8d1e-61e73dbe6d6b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f749a3a6-5107-4def-8d1e-61e73dbe6d6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:58:59.742414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:59.743309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:59.744129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:58:59.744129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:58:59.744129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:58:59.744129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:58:59.744129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:58:59.744129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:58:59.744129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:58:59.744129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:59.749341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 278/534] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:59.750307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749a3a6-5107-4def-8d1e-61e73dbe6d6b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.764470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0d6e6-487f-45cd-be23-c5c279a8a735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.765740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0d6e6-487f-45cd-be23-c5c279a8a735 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.766190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0d6e6-487f-45cd-be23-c5c279a8a735 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.766653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0d6e6-487f-45cd-be23-c5c279a8a735 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.767533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0d6e6-487f-45cd-be23-c5c279a8a735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:59.768066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0d6e6-487f-45cd-be23-c5c279a8a735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.769818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0d6e6-487f-45cd-be23-c5c279a8a735 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.788015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 257/535] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:59.789167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0d6e6-487f-45cd-be23-c5c279a8a735 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.862462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:59.887485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749a3a6-5107-4def-8d1e-61e73dbe6d6b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:59.901479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:59.925814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f82e1-c481-4078-800b-b0ed5633f6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.926737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f82e1-c481-4078-800b-b0ed5633f6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.927156 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f82e1-c481-4078-800b-b0ed5633f6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.927609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f82e1-c481-4078-800b-b0ed5633f6f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.927860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0d6e6-487f-45cd-be23-c5c279a8a735 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:59.935191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f82e1-c481-4078-800b-b0ed5633f6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.936977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f82e1-c481-4078-800b-b0ed5633f6f7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6d9f82e1-c481-4078-800b-b0ed5633f6f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:58:59.951177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:58:59.952309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:58:59.953346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:58:59.953346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:58:59.953346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:58:59.953346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:58:59.953346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:58:59.953346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:58:59.953346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:58:59.953346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:58:59.955039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 279/536] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:58:59.956065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f82e1-c481-4078-800b-b0ed5633f6f7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:59.969741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba87b77-4f7f-429c-adba-980aca6e367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:59.970812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba87b77-4f7f-429c-adba-980aca6e367b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:59.971189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba87b77-4f7f-429c-adba-980aca6e367b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:59.971835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba87b77-4f7f-429c-adba-980aca6e367b None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:59.972635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba87b77-4f7f-429c-adba-980aca6e367b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:59.973292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba87b77-4f7f-429c-adba-980aca6e367b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:59.975406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba87b77-4f7f-429c-adba-980aca6e367b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:59.995570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 258/537] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:59.995570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba87b77-4f7f-429c-adba-980aca6e367b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:00.076849 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f82e1-c481-4078-800b-b0ed5633f6f7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:00.114189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91a80d-8693-4289-9bf5-3fc882b7fab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:00.115214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91a80d-8693-4289-9bf5-3fc882b7fab6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:00.115693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91a80d-8693-4289-9bf5-3fc882b7fab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:00.116165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91a80d-8693-4289-9bf5-3fc882b7fab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:00.117071 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91a80d-8693-4289-9bf5-3fc882b7fab6 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=c9cdd3fefd3f44eeaf19adbfac1ea13b) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:00.117592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91a80d-8693-4289-9bf5-3fc882b7fab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:00.117833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba87b77-4f7f-429c-adba-980aca6e367b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:00.119608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91a80d-8693-4289-9bf5-3fc882b7fab6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:00.126459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 280/538] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/role_assignments?user.id=c9cdd3fefd3f44eeaf19adbfac1ea13b&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:00.127503 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91a80d-8693-4289-9bf5-3fc882b7fab6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:00.139112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:00.183012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91312f07-254f-4340-82bf-94466cab075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:00.184060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91312f07-254f-4340-82bf-94466cab075f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:00.184544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91312f07-254f-4340-82bf-94466cab075f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:00.185145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91312f07-254f-4340-82bf-94466cab075f None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:00.189773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91312f07-254f-4340-82bf-94466cab075f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:00.190438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91312f07-254f-4340-82bf-94466cab075f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:00.192242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91312f07-254f-4340-82bf-94466cab075f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:00.211813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:00.229448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 259/539] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:00.231350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91312f07-254f-4340-82bf-94466cab075f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:00.312600 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91a80d-8693-4289-9bf5-3fc882b7fab6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:00.348708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73396b2-b3c0-4d07-8acb-7cf9e9dc1e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:00.349702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73396b2-b3c0-4d07-8acb-7cf9e9dc1e28 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:00.350233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73396b2-b3c0-4d07-8acb-7cf9e9dc1e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:00.350725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73396b2-b3c0-4d07-8acb-7cf9e9dc1e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:00.351663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73396b2-b3c0-4d07-8acb-7cf9e9dc1e28 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=4fe0dabaf0ef4fc7b417d378334413c6) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:00.352172 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73396b2-b3c0-4d07-8acb-7cf9e9dc1e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:00.353880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73396b2-b3c0-4d07-8acb-7cf9e9dc1e28 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:00.359767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 281/540] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:00 2022] GET /identity/v3/role_assignments?user.id=4fe0dabaf0ef4fc7b417d378334413c6&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:00.414523 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91312f07-254f-4340-82bf-94466cab075f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:00.453697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d676d8b-af64-4f3c-b96b-0b8e731d5d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:00.454670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d676d8b-af64-4f3c-b96b-0b8e731d5d07 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:00.455171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d676d8b-af64-4f3c-b96b-0b8e731d5d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:00.455636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d676d8b-af64-4f3c-b96b-0b8e731d5d07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:00.456681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d676d8b-af64-4f3c-b96b-0b8e731d5d07 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=3f20fbf033f04036b48194a804dae8c3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:00.457207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d676d8b-af64-4f3c-b96b-0b8e731d5d07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:00.458973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d676d8b-af64-4f3c-b96b-0b8e731d5d07 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:00.465687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 260/541] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:00 2022] GET /identity/v3/role_assignments?user.id=3f20fbf033f04036b48194a804dae8c3&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:01.050973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064e7cf-fb98-4206-aecc-802388f180e5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:01.051984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064e7cf-fb98-4206-aecc-802388f180e5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:01.052466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064e7cf-fb98-4206-aecc-802388f180e5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:01.054355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 282/542] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:01.059485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff77039-3fde-4211-ba0d-61b28349042d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:01.060311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff77039-3fde-4211-ba0d-61b28349042d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:01.060813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff77039-3fde-4211-ba0d-61b28349042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:01.084946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6ff77039-3fde-4211-ba0d-61b28349042d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:01.086532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6ff77039-3fde-4211-ba0d-61b28349042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:01.158882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:01.170942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 261/543] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:01.691973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064e7cf-fb98-4206-aecc-802388f180e5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:01.697969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd42d-86b6-4b1f-a990-2cf08822d2f6 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:01.698494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd42d-86b6-4b1f-a990-2cf08822d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:01.699519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd42d-86b6-4b1f-a990-2cf08822d2f6 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:01.701425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 262/544] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:01.707968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952366b-36fb-4736-9f45-938683a147f0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:01.708467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952366b-36fb-4736-9f45-938683a147f0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:01.708945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952366b-36fb-4736-9f45-938683a147f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:01.742539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e952366b-36fb-4736-9f45-938683a147f0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:01.743723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e952366b-36fb-4736-9f45-938683a147f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:01.800827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:01.871730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064e7cf-fb98-4206-aecc-802388f180e5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:01.889769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 263/545] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:59:01.918418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed97ef-7c15-4427-9a04-b447e971f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:01.919071 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed97ef-7c15-4427-9a04-b447e971f077 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:01.919360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed97ef-7c15-4427-9a04-b447e971f077 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:01.919641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed97ef-7c15-4427-9a04-b447e971f077 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:01.935402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed97ef-7c15-4427-9a04-b447e971f077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-73ed97ef-7c15-4427-9a04-b447e971f077 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:01.940570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:01.941416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:01.942712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 283/546] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:01.947743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952366b-36fb-4736-9f45-938683a147f0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:02.082715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952366b-36fb-4736-9f45-938683a147f0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:02.123304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:02.139695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522080d-1655-47f9-8fdc-e20905d9f428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:02.140597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522080d-1655-47f9-8fdc-e20905d9f428 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:02.141051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522080d-1655-47f9-8fdc-e20905d9f428 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:02.141500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522080d-1655-47f9-8fdc-e20905d9f428 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:02.142363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522080d-1655-47f9-8fdc-e20905d9f428 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:02.142838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522080d-1655-47f9-8fdc-e20905d9f428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:02.144408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522080d-1655-47f9-8fdc-e20905d9f428 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:02.157565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 264/547] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:02.163374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed97ef-7c15-4427-9a04-b447e971f077 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:02.270961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522080d-1655-47f9-8fdc-e20905d9f428 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:02.297759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed97ef-7c15-4427-9a04-b447e971f077 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:02.330031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:02.334099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd02826-5d8c-4bed-9cfd-d3b9b26addd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:02.334789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd02826-5d8c-4bed-9cfd-d3b9b26addd4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:02.335072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd02826-5d8c-4bed-9cfd-d3b9b26addd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:02.335351 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd02826-5d8c-4bed-9cfd-d3b9b26addd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:02.349582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd02826-5d8c-4bed-9cfd-d3b9b26addd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:02.351186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd02826-5d8c-4bed-9cfd-d3b9b26addd4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-bbd02826-5d8c-4bed-9cfd-d3b9b26addd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:02.366897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:02.367989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:02.368841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:02.368841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:02.368841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:02.368841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 284/548] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:02.379868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd02826-5d8c-4bed-9cfd-d3b9b26addd4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:02.491273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522080d-1655-47f9-8fdc-e20905d9f428 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:02.562864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd02826-5d8c-4bed-9cfd-d3b9b26addd4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:02.566596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbf0c7-fbcf-4879-b0c8-43fb621ab7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:02.567267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbf0c7-fbcf-4879-b0c8-43fb621ab7ac None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:02.567551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbf0c7-fbcf-4879-b0c8-43fb621ab7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:02.567936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbf0c7-fbcf-4879-b0c8-43fb621ab7ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:02.596401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbf0c7-fbcf-4879-b0c8-43fb621ab7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3afbf0c7-fbcf-4879-b0c8-43fb621ab7ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:02.602858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:02.604280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:02.606052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:02.606862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3dbe8-fd39-47f8-b98d-ec86b66a4883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:02.606862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3dbe8-fd39-47f8-b98d-ec86b66a4883 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:02.606862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3dbe8-fd39-47f8-b98d-ec86b66a4883 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:02.606862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3dbe8-fd39-47f8-b98d-ec86b66a4883 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:02.607118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3dbe8-fd39-47f8-b98d-ec86b66a4883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:02.607118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3dbe8-fd39-47f8-b98d-ec86b66a4883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:02.607118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3dbe8-fd39-47f8-b98d-ec86b66a4883 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:02.610355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 265/549] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:02.615936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbf0c7-fbcf-4879-b0c8-43fb621ab7ac None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:02.620017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 285/550] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:02.625462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3dbe8-fd39-47f8-b98d-ec86b66a4883 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:02.701551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:02.715701 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:02.774779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3dbe8-fd39-47f8-b98d-ec86b66a4883 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:02.786501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbf0c7-fbcf-4879-b0c8-43fb621ab7ac None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:02.820823 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e74168-5e63-4956-b954-2a7ab87d6f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:02.821376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e74168-5e63-4956-b954-2a7ab87d6f84 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:02.821548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66f215-65fb-499f-aebe-f72605685ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:02.821701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e74168-5e63-4956-b954-2a7ab87d6f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:02.821948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e74168-5e63-4956-b954-2a7ab87d6f84 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:02.822542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f215-65fb-499f-aebe-f72605685ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:02.822986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f215-65fb-499f-aebe-f72605685ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:02.823352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f215-65fb-499f-aebe-f72605685ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:02.824644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66f215-65fb-499f-aebe-f72605685ec9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:02.825050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66f215-65fb-499f-aebe-f72605685ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:02.826545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66f215-65fb-499f-aebe-f72605685ec9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:02.830994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e74168-5e63-4956-b954-2a7ab87d6f84 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:02.832980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e74168-5e63-4956-b954-2a7ab87d6f84 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:02.841091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 266/551] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:02.842563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ff11-1b68-40df-9477-4b6f11ae1368 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:02.842948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ff11-1b68-40df-9477-4b6f11ae1368 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:02.843327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ff11-1b68-40df-9477-4b6f11ae1368 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:02.844921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 267/552] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:02.845785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ff11-1b68-40df-9477-4b6f11ae1368 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-99e74168-5e63-4956-b954-2a7ab87d6f84 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:02.846076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:02.847007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:02.847896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 286/553] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:02.852033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8023e36-cc4f-4db6-878e-a7df28fd79ca None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:02.852315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8023e36-cc4f-4db6-878e-a7df28fd79ca None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:02.852583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8023e36-cc4f-4db6-878e-a7df28fd79ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:02.875468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a8023e36-cc4f-4db6-878e-a7df28fd79ca None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:02.876655 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a8023e36-cc4f-4db6-878e-a7df28fd79ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:02.964899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 287/554] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:02.966648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8023e36-cc4f-4db6-878e-a7df28fd79ca None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:02.993229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ff11-1b68-40df-9477-4b6f11ae1368 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:03.007310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:03.027356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:03.063890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73538991-dd4e-423e-82fb-dd1ef0cf9f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:03.064530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73538991-dd4e-423e-82fb-dd1ef0cf9f3c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.064810 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73538991-dd4e-423e-82fb-dd1ef0cf9f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.065083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73538991-dd4e-423e-82fb-dd1ef0cf9f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.084104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73538991-dd4e-423e-82fb-dd1ef0cf9f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:03.086402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73538991-dd4e-423e-82fb-dd1ef0cf9f3c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-73538991-dd4e-423e-82fb-dd1ef0cf9f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:03.112220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:03.114395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:03.116939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:03.116939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:03.116939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:03.117762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 268/555] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:03.118987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a21a10-0967-4f0a-ae01-f4761010e3c4 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.119270 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a21a10-0967-4f0a-ae01-f4761010e3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.119544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a21a10-0967-4f0a-ae01-f4761010e3c4 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.121672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 269/556] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:03.123281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf304-d263-46a2-87da-1396bac29625 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.123568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf304-d263-46a2-87da-1396bac29625 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.123843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf304-d263-46a2-87da-1396bac29625 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.129006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 270/557] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:03.129006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf304-d263-46a2-87da-1396bac29625 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:03.143366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8023e36-cc4f-4db6-878e-a7df28fd79ca None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:03.179725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82d734-2f59-4b38-9695-e62bdfe5eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:03.180349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82d734-2f59-4b38-9695-e62bdfe5eccc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.180588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82d734-2f59-4b38-9695-e62bdfe5eccc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.180856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82d734-2f59-4b38-9695-e62bdfe5eccc None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.181567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82d734-2f59-4b38-9695-e62bdfe5eccc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:03.181895 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82d734-2f59-4b38-9695-e62bdfe5eccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:03.183342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82d734-2f59-4b38-9695-e62bdfe5eccc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:03.221089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 288/558] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 19 11:59:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:03.222421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0959b-1415-4b70-a491-a8374added29 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.222710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0959b-1415-4b70-a491-a8374added29 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.222985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0959b-1415-4b70-a491-a8374added29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.235916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf304-d263-46a2-87da-1396bac29625 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:03.243351 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e6c0959b-1415-4b70-a491-a8374added29 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:03.244525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e6c0959b-1415-4b70-a491-a8374added29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:03.270918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913ec0a-92d3-42ae-806c-a69a26ab3247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:03.271526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913ec0a-92d3-42ae-806c-a69a26ab3247 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.271802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913ec0a-92d3-42ae-806c-a69a26ab3247 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.272077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913ec0a-92d3-42ae-806c-a69a26ab3247 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.272772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913ec0a-92d3-42ae-806c-a69a26ab3247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:03.273078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913ec0a-92d3-42ae-806c-a69a26ab3247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:03.274475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913ec0a-92d3-42ae-806c-a69a26ab3247 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:03.286958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 271/559] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:03.291350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607741-cc5e-4a6b-b84f-15d57a30e325 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.292182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607741-cc5e-4a6b-b84f-15d57a30e325 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.292549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607741-cc5e-4a6b-b84f-15d57a30e325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.310229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f6607741-cc5e-4a6b-b84f-15d57a30e325 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:03.311425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f6607741-cc5e-4a6b-b84f-15d57a30e325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:03.312591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 289/560] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:03.313414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0959b-1415-4b70-a491-a8374added29 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:03.325267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:03.343372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:03.385691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 272/561] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:03.385691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607741-cc5e-4a6b-b84f-15d57a30e325 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:03.438577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0959b-1415-4b70-a491-a8374added29 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:03.483285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56abb9f-806d-455b-988a-d21a94c0c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:03.484123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56abb9f-806d-455b-988a-d21a94c0c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.484721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56abb9f-806d-455b-988a-d21a94c0c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.485148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56abb9f-806d-455b-988a-d21a94c0c6d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.525656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607741-cc5e-4a6b-b84f-15d57a30e325 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:03.566324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56abb9f-806d-455b-988a-d21a94c0c6d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:03.568010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56abb9f-806d-455b-988a-d21a94c0c6d1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:03.572189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c6c4d-cbd1-455f-a994-bffd6281d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:03.572930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6c4d-cbd1-455f-a994-bffd6281d748 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.573311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6c4d-cbd1-455f-a994-bffd6281d748 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.574257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6c4d-cbd1-455f-a994-bffd6281d748 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.586276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c6c4d-cbd1-455f-a994-bffd6281d748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:03.587629 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0b4c6c4d-cbd1-455f-a994-bffd6281d748 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:03.592142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:03.593264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:03.594438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:03.598328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 273/562] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:03.599156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c6c4d-cbd1-455f-a994-bffd6281d748 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:03.609931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:03.685454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 290/563] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:03.686322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56abb9f-806d-455b-988a-d21a94c0c6d1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:03.706265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c6c4d-cbd1-455f-a994-bffd6281d748 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:03.744984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232d1e4-c05f-4783-b187-1d8be3c22a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:03.745697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232d1e4-c05f-4783-b187-1d8be3c22a2d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.746041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232d1e4-c05f-4783-b187-1d8be3c22a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.746314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232d1e4-c05f-4783-b187-1d8be3c22a2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.753113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232d1e4-c05f-4783-b187-1d8be3c22a2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:03.754591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232d1e4-c05f-4783-b187-1d8be3c22a2d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7232d1e4-c05f-4783-b187-1d8be3c22a2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:03.766598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:03.767704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 274/564] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 19 11:59:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:03.768897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232d1e4-c05f-4783-b187-1d8be3c22a2d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:03.787307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56abb9f-806d-455b-988a-d21a94c0c6d1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:03.803358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:03.820913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015046fd-2782-4e68-8437-9b7a9c7ce799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:03.821535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015046fd-2782-4e68-8437-9b7a9c7ce799 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.821838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015046fd-2782-4e68-8437-9b7a9c7ce799 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.822106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015046fd-2782-4e68-8437-9b7a9c7ce799 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.832168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015046fd-2782-4e68-8437-9b7a9c7ce799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:03.836361 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-015046fd-2782-4e68-8437-9b7a9c7ce799 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:03.837080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:03.838079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 291/565] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:03.842443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015046fd-2782-4e68-8437-9b7a9c7ce799 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:03.875487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232d1e4-c05f-4783-b187-1d8be3c22a2d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:03.907632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdeca3-e1b5-490a-bc1a-dd6b3b03385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:03.908232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdeca3-e1b5-490a-bc1a-dd6b3b03385d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.908517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdeca3-e1b5-490a-bc1a-dd6b3b03385d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.908785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdeca3-e1b5-490a-bc1a-dd6b3b03385d None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.909446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdeca3-e1b5-490a-bc1a-dd6b3b03385d None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:03.909778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdeca3-e1b5-490a-bc1a-dd6b3b03385d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:03.911142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdeca3-e1b5-490a-bc1a-dd6b3b03385d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:03.918911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 275/566] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:03.919691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdeca3-e1b5-490a-bc1a-dd6b3b03385d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:03.939439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015046fd-2782-4e68-8437-9b7a9c7ce799 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:03.974458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd527b0-1bb8-4198-b1d8-93316cc2888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:03.975519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd527b0-1bb8-4198-b1d8-93316cc2888d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:03.976001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd527b0-1bb8-4198-b1d8-93316cc2888d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:03.976500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd527b0-1bb8-4198-b1d8-93316cc2888d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:03.988523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd527b0-1bb8-4198-b1d8-93316cc2888d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ffd527b0-1bb8-4198-b1d8-93316cc2888d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:03.993274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:04.000721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 292/567] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:04.001842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd527b0-1bb8-4198-b1d8-93316cc2888d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.017774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdeca3-e1b5-490a-bc1a-dd6b3b03385d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.032153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:04.045474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:04.051970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fd990-2759-40e7-ba26-5ee3c11d4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.053005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fd990-2759-40e7-ba26-5ee3c11d4d5e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.053507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fd990-2759-40e7-ba26-5ee3c11d4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.054126 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fd990-2759-40e7-ba26-5ee3c11d4d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.068471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fd990-2759-40e7-ba26-5ee3c11d4d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.069944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fd990-2759-40e7-ba26-5ee3c11d4d5e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-593fd990-2759-40e7-ba26-5ee3c11d4d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:04.084526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:04.086022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:04.086891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:04.086891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:04.086891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:04.086891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 276/568] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:04.086891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fd990-2759-40e7-ba26-5ee3c11d4d5e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.103668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd527b0-1bb8-4198-b1d8-93316cc2888d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.138806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f13af-7be0-4bf2-8410-9300548dd801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.139345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f13af-7be0-4bf2-8410-9300548dd801 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.139627 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f13af-7be0-4bf2-8410-9300548dd801 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.139903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f13af-7be0-4bf2-8410-9300548dd801 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.140622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f13af-7be0-4bf2-8410-9300548dd801 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:04.140935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f13af-7be0-4bf2-8410-9300548dd801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.142400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f13af-7be0-4bf2-8410-9300548dd801 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.159278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 293/569] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 19 11:59:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:04.160063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f13af-7be0-4bf2-8410-9300548dd801 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.187910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fd990-2759-40e7-ba26-5ee3c11d4d5e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.222171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d402741-cd14-4a25-a04b-8aed94a588cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.222767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d402741-cd14-4a25-a04b-8aed94a588cd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.223301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d402741-cd14-4a25-a04b-8aed94a588cd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.223575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d402741-cd14-4a25-a04b-8aed94a588cd None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.224233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d402741-cd14-4a25-a04b-8aed94a588cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:04.224532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d402741-cd14-4a25-a04b-8aed94a588cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.225919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d402741-cd14-4a25-a04b-8aed94a588cd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.234265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 277/570] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:04.235041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d402741-cd14-4a25-a04b-8aed94a588cd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.254882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:04.262206 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f13af-7be0-4bf2-8410-9300548dd801 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.279552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:04.296759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d918e7-70d6-4b5d-96c5-bb869e236b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.297384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d918e7-70d6-4b5d-96c5-bb869e236b82 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.297682 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d918e7-70d6-4b5d-96c5-bb869e236b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.297999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d918e7-70d6-4b5d-96c5-bb869e236b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.308986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d918e7-70d6-4b5d-96c5-bb869e236b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.310480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d918e7-70d6-4b5d-96c5-bb869e236b82 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-42d918e7-70d6-4b5d-96c5-bb869e236b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:04.325258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:04.326299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:04.327194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:04.327194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:04.327194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:04.327194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 294/571] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:04.327194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d918e7-70d6-4b5d-96c5-bb869e236b82 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.338412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d402741-cd14-4a25-a04b-8aed94a588cd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.371741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dba27-966f-491a-b4c6-08857660efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.372336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dba27-966f-491a-b4c6-08857660efa9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.372611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dba27-966f-491a-b4c6-08857660efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.372882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dba27-966f-491a-b4c6-08857660efa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.373531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dba27-966f-491a-b4c6-08857660efa9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:04.373875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dba27-966f-491a-b4c6-08857660efa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.375232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dba27-966f-491a-b4c6-08857660efa9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.382843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 278/572] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:04.383603 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dba27-966f-491a-b4c6-08857660efa9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.424426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d918e7-70d6-4b5d-96c5-bb869e236b82 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.456330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cb528-feb3-403a-bc3e-249f28ede5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.456948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cb528-feb3-403a-bc3e-249f28ede5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.457221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cb528-feb3-403a-bc3e-249f28ede5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.457491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cb528-feb3-403a-bc3e-249f28ede5e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.458139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cb528-feb3-403a-bc3e-249f28ede5e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:04.458443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cb528-feb3-403a-bc3e-249f28ede5e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.459810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cb528-feb3-403a-bc3e-249f28ede5e4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.471684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 295/573] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:04.472457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cb528-feb3-403a-bc3e-249f28ede5e4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.481412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dba27-966f-491a-b4c6-08857660efa9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.482452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:04.488262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:04.515221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa879f9-b814-4bef-a44e-35165e85b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.515840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa879f9-b814-4bef-a44e-35165e85b618 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.516112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa879f9-b814-4bef-a44e-35165e85b618 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.516380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa879f9-b814-4bef-a44e-35165e85b618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.526785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa879f9-b814-4bef-a44e-35165e85b618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.528732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa879f9-b814-4bef-a44e-35165e85b618 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ffa879f9-b814-4bef-a44e-35165e85b618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:04.542607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:04.543790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:04.544668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:04.544668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:04.544668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:04.544668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 279/574] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:04.544668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa879f9-b814-4bef-a44e-35165e85b618 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.575327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cb528-feb3-403a-bc3e-249f28ede5e4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.609494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474b1fa-8a79-4f21-b447-2472e19559ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.610144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474b1fa-8a79-4f21-b447-2472e19559ce None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.610421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474b1fa-8a79-4f21-b447-2472e19559ce None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.610695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474b1fa-8a79-4f21-b447-2472e19559ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.621149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474b1fa-8a79-4f21-b447-2472e19559ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.622762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474b1fa-8a79-4f21-b447-2472e19559ce None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2474b1fa-8a79-4f21-b447-2472e19559ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:04.638192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:04.639160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:04.640037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:04.640037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:04.640037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:04.640037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 296/575] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:04.640037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474b1fa-8a79-4f21-b447-2472e19559ce None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.646123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa879f9-b814-4bef-a44e-35165e85b618 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.682833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6260d68-d692-433b-8824-6fde1377e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.683625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6260d68-d692-433b-8824-6fde1377e3bc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.683907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6260d68-d692-433b-8824-6fde1377e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.684179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6260d68-d692-433b-8824-6fde1377e3bc None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.684816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6260d68-d692-433b-8824-6fde1377e3bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:04.685123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6260d68-d692-433b-8824-6fde1377e3bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.686516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6260d68-d692-433b-8824-6fde1377e3bc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.697943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 280/576] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:04.698771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6260d68-d692-433b-8824-6fde1377e3bc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.705713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:04.717164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:04.748858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474b1fa-8a79-4f21-b447-2472e19559ce None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.782799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a5393-d45d-43ce-b7f4-96b1319bf16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.783433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a5393-d45d-43ce-b7f4-96b1319bf16a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.783715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a5393-d45d-43ce-b7f4-96b1319bf16a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.783991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a5393-d45d-43ce-b7f4-96b1319bf16a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.795266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a5393-d45d-43ce-b7f4-96b1319bf16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.796716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a5393-d45d-43ce-b7f4-96b1319bf16a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.800259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6260d68-d692-433b-8824-6fde1377e3bc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-528a5393-d45d-43ce-b7f4-96b1319bf16a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:04.810873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:04.811804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:04.812668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:04.812668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:04.812668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:04.812668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 297/577] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:04.812892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a5393-d45d-43ce-b7f4-96b1319bf16a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.836583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61995162-9dde-4581-b71b-e45fdc16d2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.837207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61995162-9dde-4581-b71b-e45fdc16d2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.837485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61995162-9dde-4581-b71b-e45fdc16d2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.837800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61995162-9dde-4581-b71b-e45fdc16d2a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.845110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61995162-9dde-4581-b71b-e45fdc16d2a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.846621 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61995162-9dde-4581-b71b-e45fdc16d2a0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-61995162-9dde-4581-b71b-e45fdc16d2a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:04.859074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:04.860155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:04.866311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:04.866311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:04.866311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:04.866311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:04.866311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:04.866311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:04.866311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:04.866311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:04.866311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 281/578] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:04.866311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61995162-9dde-4581-b71b-e45fdc16d2a0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.912084 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a5393-d45d-43ce-b7f4-96b1319bf16a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.922558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:04.940420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:04.946768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240fbb9-6fa1-4904-afde-b394a954782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.947378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fbb9-6fa1-4904-afde-b394a954782b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.947663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fbb9-6fa1-4904-afde-b394a954782b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.947937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fbb9-6fa1-4904-afde-b394a954782b None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.948630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240fbb9-6fa1-4904-afde-b394a954782b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:04.948931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240fbb9-6fa1-4904-afde-b394a954782b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.950345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240fbb9-6fa1-4904-afde-b394a954782b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:04.961636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 298/579] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:04.961863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61995162-9dde-4581-b71b-e45fdc16d2a0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.962438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240fbb9-6fa1-4904-afde-b394a954782b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.996347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3523c68-8797-4c10-b3e2-843bb587c677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.996948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523c68-8797-4c10-b3e2-843bb587c677 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.997224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523c68-8797-4c10-b3e2-843bb587c677 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.997496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523c68-8797-4c10-b3e2-843bb587c677 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.998156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3523c68-8797-4c10-b3e2-843bb587c677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:04.998483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3523c68-8797-4c10-b3e2-843bb587c677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.999825 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3523c68-8797-4c10-b3e2-843bb587c677 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.011040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 282/580] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:05.012542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3523c68-8797-4c10-b3e2-843bb587c677 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.061225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240fbb9-6fa1-4904-afde-b394a954782b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.097453 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64126fee-d4ba-4a78-af7f-7b36e0e70dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.098814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64126fee-d4ba-4a78-af7f-7b36e0e70dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.099298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64126fee-d4ba-4a78-af7f-7b36e0e70dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.099729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64126fee-d4ba-4a78-af7f-7b36e0e70dc0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.107128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64126fee-d4ba-4a78-af7f-7b36e0e70dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.108543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64126fee-d4ba-4a78-af7f-7b36e0e70dc0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.118888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3523c68-8797-4c10-b3e2-843bb587c677 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-64126fee-d4ba-4a78-af7f-7b36e0e70dc0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:05.119751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:05.120965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 299/581] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:05.122545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64126fee-d4ba-4a78-af7f-7b36e0e70dc0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.152703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:05.157460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0593e94-e922-4a70-a673-de4e8da40583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.158093 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593e94-e922-4a70-a673-de4e8da40583 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.158369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593e94-e922-4a70-a673-de4e8da40583 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.158643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593e94-e922-4a70-a673-de4e8da40583 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.159272 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0593e94-e922-4a70-a673-de4e8da40583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:05.159574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0593e94-e922-4a70-a673-de4e8da40583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.160945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0593e94-e922-4a70-a673-de4e8da40583 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.167293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:05.172446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 283/582] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:05.174495 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0593e94-e922-4a70-a673-de4e8da40583 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.221067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64126fee-d4ba-4a78-af7f-7b36e0e70dc0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.254349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39288b-137c-4d8d-b31f-361e1720dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.254946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39288b-137c-4d8d-b31f-361e1720dff8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.255493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39288b-137c-4d8d-b31f-361e1720dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.255493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39288b-137c-4d8d-b31f-361e1720dff8 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.256147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39288b-137c-4d8d-b31f-361e1720dff8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:05.256445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39288b-137c-4d8d-b31f-361e1720dff8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.257898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39288b-137c-4d8d-b31f-361e1720dff8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.270754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 300/583] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:05.271524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39288b-137c-4d8d-b31f-361e1720dff8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.272650 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0593e94-e922-4a70-a673-de4e8da40583 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.306570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1705d-ce4f-49b2-9cfd-f7bf38666393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.307198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1705d-ce4f-49b2-9cfd-f7bf38666393 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.307479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1705d-ce4f-49b2-9cfd-f7bf38666393 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.307753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1705d-ce4f-49b2-9cfd-f7bf38666393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.314484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1705d-ce4f-49b2-9cfd-f7bf38666393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.315911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1705d-ce4f-49b2-9cfd-f7bf38666393 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-93f1705d-ce4f-49b2-9cfd-f7bf38666393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:05.327384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:05.328425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:05.329482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:05.329482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:05.329482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:05.329482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:05.329482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:05.329482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:05.329482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:05.329482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:05.329482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 284/584] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:05.329482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1705d-ce4f-49b2-9cfd-f7bf38666393 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.366138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:05.376779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39288b-137c-4d8d-b31f-361e1720dff8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.388872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:05.410675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a9a18-ebb3-45c3-bd8a-a8646a38a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.411484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9a18-ebb3-45c3-bd8a-a8646a38a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.411771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9a18-ebb3-45c3-bd8a-a8646a38a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.412074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9a18-ebb3-45c3-bd8a-a8646a38a8c8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.420005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a9a18-ebb3-45c3-bd8a-a8646a38a8c8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.421469 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a9a18-ebb3-45c3-bd8a-a8646a38a8c8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.429452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1705d-ce4f-49b2-9cfd-f7bf38666393 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-682a9a18-ebb3-45c3-bd8a-a8646a38a8c8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:05.433675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:05.434764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 301/585] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:05.435711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a9a18-ebb3-45c3-bd8a-a8646a38a8c8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.468049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96f0ea-1a55-4831-bddc-2dafe445330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.468652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96f0ea-1a55-4831-bddc-2dafe445330c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.468934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96f0ea-1a55-4831-bddc-2dafe445330c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.469204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96f0ea-1a55-4831-bddc-2dafe445330c None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.469953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96f0ea-1a55-4831-bddc-2dafe445330c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:05.470257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96f0ea-1a55-4831-bddc-2dafe445330c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.471725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96f0ea-1a55-4831-bddc-2dafe445330c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.488435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 285/586] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:05.489228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96f0ea-1a55-4831-bddc-2dafe445330c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.538706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a9a18-ebb3-45c3-bd8a-a8646a38a8c8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.572684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcbb4b-8c15-4218-85a3-eba7618afa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.573313 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcbb4b-8c15-4218-85a3-eba7618afa34 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.573585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcbb4b-8c15-4218-85a3-eba7618afa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.574468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcbb4b-8c15-4218-85a3-eba7618afa34 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.581725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcbb4b-8c15-4218-85a3-eba7618afa34 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.583137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcbb4b-8c15-4218-85a3-eba7618afa34 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.588463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96f0ea-1a55-4831-bddc-2dafe445330c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-69bcbb4b-8c15-4218-85a3-eba7618afa34 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:05.594125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:05.595103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 302/587] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:05.596035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcbb4b-8c15-4218-85a3-eba7618afa34 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.606939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:05.608205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:05.625849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a36ebb-134f-4045-92dc-377ed9d0b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.626453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36ebb-134f-4045-92dc-377ed9d0b63e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.626730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36ebb-134f-4045-92dc-377ed9d0b63e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.627001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36ebb-134f-4045-92dc-377ed9d0b63e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.627712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a36ebb-134f-4045-92dc-377ed9d0b63e None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=7b33b44f0e354c16846dd87179131141) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:05.628016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a36ebb-134f-4045-92dc-377ed9d0b63e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.629436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a36ebb-134f-4045-92dc-377ed9d0b63e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.634722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 286/588] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/role_assignments?user.id=7b33b44f0e354c16846dd87179131141&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:05.635499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a36ebb-134f-4045-92dc-377ed9d0b63e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.728405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcbb4b-8c15-4218-85a3-eba7618afa34 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.758435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a36ebb-134f-4045-92dc-377ed9d0b63e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.782750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e928653-2630-47c9-ad41-82f458fd28bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.783381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e928653-2630-47c9-ad41-82f458fd28bb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.783660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e928653-2630-47c9-ad41-82f458fd28bb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.783935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e928653-2630-47c9-ad41-82f458fd28bb None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.784647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e928653-2630-47c9-ad41-82f458fd28bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:05.784958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e928653-2630-47c9-ad41-82f458fd28bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.786444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e928653-2630-47c9-ad41-82f458fd28bb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.798022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec812b1b-d829-4ce3-9db1-283bec333873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.798999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec812b1b-d829-4ce3-9db1-283bec333873 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.799424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec812b1b-d829-4ce3-9db1-283bec333873 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.799857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec812b1b-d829-4ce3-9db1-283bec333873 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.800443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 303/589] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:05.800895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec812b1b-d829-4ce3-9db1-283bec333873 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:05.801339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e928653-2630-47c9-ad41-82f458fd28bb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.801446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec812b1b-d829-4ce3-9db1-283bec333873 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.803113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec812b1b-d829-4ce3-9db1-283bec333873 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.831163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 287/590] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:05.831163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec812b1b-d829-4ce3-9db1-283bec333873 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.869521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:05.879355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:05.917240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e928653-2630-47c9-ad41-82f458fd28bb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.939651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec812b1b-d829-4ce3-9db1-283bec333873 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.955365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b46221-4b88-41fd-a6b3-50e295e77e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.956237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b46221-4b88-41fd-a6b3-50e295e77e6c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.956671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b46221-4b88-41fd-a6b3-50e295e77e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.957088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b46221-4b88-41fd-a6b3-50e295e77e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.967777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b46221-4b88-41fd-a6b3-50e295e77e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.969258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b46221-4b88-41fd-a6b3-50e295e77e6c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.977575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c5f14-6592-4e48-b7c0-4dbb8e5601cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.978396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c5f14-6592-4e48-b7c0-4dbb8e5601cb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.978888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c5f14-6592-4e48-b7c0-4dbb8e5601cb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.979306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c5f14-6592-4e48-b7c0-4dbb8e5601cb None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.981110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c5f14-6592-4e48-b7c0-4dbb8e5601cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:05.981568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c5f14-6592-4e48-b7c0-4dbb8e5601cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.983233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c5f14-6592-4e48-b7c0-4dbb8e5601cb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d4b46221-4b88-41fd-a6b3-50e295e77e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:05.985850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:05.986952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:05.988005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:05.988005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:05.988005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:05.988005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 304/591] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:05.988236 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b46221-4b88-41fd-a6b3-50e295e77e6c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.004659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 288/592] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 19 11:59:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:06.005909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c5f14-6592-4e48-b7c0-4dbb8e5601cb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.102957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b46221-4b88-41fd-a6b3-50e295e77e6c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:06.103477 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:06.110011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c5f14-6592-4e48-b7c0-4dbb8e5601cb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:06.130716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:06.143548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a97d3-2f18-4a46-8a42-c647e31f658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:06.144213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a97d3-2f18-4a46-8a42-c647e31f658c None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:06.144500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a97d3-2f18-4a46-8a42-c647e31f658c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:06.144782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a97d3-2f18-4a46-8a42-c647e31f658c None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/02430b0097f94fa0a2015480a6ec68eb/roles/c926095789574c45a0a5fd3f2a25262f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:06.150931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2170f0-5785-4283-b358-61b7f470aae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:06.151569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2170f0-5785-4283-b358-61b7f470aae5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:06.152371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2170f0-5785-4283-b358-61b7f470aae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:06.152640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2170f0-5785-4283-b358-61b7f470aae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:06.160087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a97d3-2f18-4a46-8a42-c647e31f658c None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=02430b0097f94fa0a2015480a6ec68eb, role_id=c926095789574c45a0a5fd3f2a25262f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:06.162078 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a97d3-2f18-4a46-8a42-c647e31f658c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:06.164331 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2170f0-5785-4283-b358-61b7f470aae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:06.166328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2170f0-5785-4283-b358-61b7f470aae5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:06.185655 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 305/593] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:59:05 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/02430b0097f94fa0a2015480a6ec68eb/roles/c926095789574c45a0a5fd3f2a25262f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:59:06.185655 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a97d3-2f18-4a46-8a42-c647e31f658c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-8c2170f0-5785-4283-b358-61b7f470aae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:06.185949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:06.186808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:06.187693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:06.187693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:06.187693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:06.187693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 289/594] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:06.187693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2170f0-5785-4283-b358-61b7f470aae5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.317574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2170f0-5785-4283-b358-61b7f470aae5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:06.339943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a97d3-2f18-4a46-8a42-c647e31f658c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:06.369190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f278a64-736a-4d97-8bb1-f4142bac0590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:06.370401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278a64-736a-4d97-8bb1-f4142bac0590 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:06.370881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278a64-736a-4d97-8bb1-f4142bac0590 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:06.371337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278a64-736a-4d97-8bb1-f4142bac0590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:06.384672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f278a64-736a-4d97-8bb1-f4142bac0590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:06.386535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f278a64-736a-4d97-8bb1-f4142bac0590 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:06.389649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad305-d22f-45a2-8270-438418ff7cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:06.390268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad305-d22f-45a2-8270-438418ff7cef None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:06.390547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad305-d22f-45a2-8270-438418ff7cef None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:06.390824 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad305-d22f-45a2-8270-438418ff7cef None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:06.391463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ad305-d22f-45a2-8270-438418ff7cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:06.391763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ad305-d22f-45a2-8270-438418ff7cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:06.393115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ad305-d22f-45a2-8270-438418ff7cef None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:06.397020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:06.406470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 306/595] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:06.407107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad305-d22f-45a2-8270-438418ff7cef None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-9f278a64-736a-4d97-8bb1-f4142bac0590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:06.407284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:06.408157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:06.409569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:06.409569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:06.409569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:06.409569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 290/596] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:06.413064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f278a64-736a-4d97-8bb1-f4142bac0590 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.453152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:06.536373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f278a64-736a-4d97-8bb1-f4142bac0590 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:06.536602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad305-d22f-45a2-8270-438418ff7cef None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:06.572402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41f79f-2419-4263-94df-de79bfda25dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:06.572935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f79f-2419-4263-94df-de79bfda25dd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:06.573218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f79f-2419-4263-94df-de79bfda25dd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:06.573490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f79f-2419-4263-94df-de79bfda25dd None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:06.574731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41f79f-2419-4263-94df-de79bfda25dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:06.575039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41f79f-2419-4263-94df-de79bfda25dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:06.576403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41f79f-2419-4263-94df-de79bfda25dd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:06.581330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0480d69-8a88-4d40-9785-e463f32533bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:06.582004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0480d69-8a88-4d40-9785-e463f32533bc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:06.582290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0480d69-8a88-4d40-9785-e463f32533bc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:06.582561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0480d69-8a88-4d40-9785-e463f32533bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:06.590240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 307/597] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:06.591062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41f79f-2419-4263-94df-de79bfda25dd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.601802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0480d69-8a88-4d40-9785-e463f32533bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:06.604191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0480d69-8a88-4d40-9785-e463f32533bc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a0480d69-8a88-4d40-9785-e463f32533bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:06.622215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:06.623201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:06.624064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:06.624064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:06.624064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:06.624064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:06.624064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:06.624064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:06.624064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:06.624064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:06.625529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 291/598] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:06.625529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0480d69-8a88-4d40-9785-e463f32533bc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.701980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:06.707678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:06.713573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41f79f-2419-4263-94df-de79bfda25dd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:06.751444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477d074-d09e-4b64-abc0-0bb47f6b7af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:06.752417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477d074-d09e-4b64-abc0-0bb47f6b7af7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:06.752950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477d074-d09e-4b64-abc0-0bb47f6b7af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:06.753372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477d074-d09e-4b64-abc0-0bb47f6b7af7 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:06.754239 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477d074-d09e-4b64-abc0-0bb47f6b7af7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:06.754783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477d074-d09e-4b64-abc0-0bb47f6b7af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:06.756419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477d074-d09e-4b64-abc0-0bb47f6b7af7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:06.758588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0480d69-8a88-4d40-9785-e463f32533bc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:06.774655 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 308/599] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:06.775729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477d074-d09e-4b64-abc0-0bb47f6b7af7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.798986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2105-55b2-4c07-9c9f-8d9f2198b9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:06.799618 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2105-55b2-4c07-9c9f-8d9f2198b9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:06.799897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2105-55b2-4c07-9c9f-8d9f2198b9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:06.800171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a2105-55b2-4c07-9c9f-8d9f2198b9e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:06.808688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a2105-55b2-4c07-9c9f-8d9f2198b9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:06.810718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a2105-55b2-4c07-9c9f-8d9f2198b9e9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-996a2105-55b2-4c07-9c9f-8d9f2198b9e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:06.826262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:06.827337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:06.828349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:06.828349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:06.828349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:06.828349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:06.828349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:06.828349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:06.828349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:06.828349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:06.832118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 292/600] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:06.832931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2105-55b2-4c07-9c9f-8d9f2198b9e9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.896337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477d074-d09e-4b64-abc0-0bb47f6b7af7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:06.934437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d90c7-5297-47c4-8ba8-c4eae88a3845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:06.935504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d90c7-5297-47c4-8ba8-c4eae88a3845 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:06.936077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d90c7-5297-47c4-8ba8-c4eae88a3845 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:06.936552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d90c7-5297-47c4-8ba8-c4eae88a3845 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:06.937439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d90c7-5297-47c4-8ba8-c4eae88a3845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:06.937902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a2105-55b2-4c07-9c9f-8d9f2198b9e9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:06.938221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d90c7-5297-47c4-8ba8-c4eae88a3845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:06.940061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d90c7-5297-47c4-8ba8-c4eae88a3845 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:06.959291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:06.959860 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 309/601] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:06.961838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d90c7-5297-47c4-8ba8-c4eae88a3845 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:06.974645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46038040-2244-4bef-bdad-c075ccf37966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:06.975337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46038040-2244-4bef-bdad-c075ccf37966 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:06.975831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46038040-2244-4bef-bdad-c075ccf37966 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:06.975941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46038040-2244-4bef-bdad-c075ccf37966 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:06.980530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:06.983129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46038040-2244-4bef-bdad-c075ccf37966 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:06.984651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46038040-2244-4bef-bdad-c075ccf37966 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-46038040-2244-4bef-bdad-c075ccf37966 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:06.997597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:06.998530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:06.999433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:06.999433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:06.999433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:06.999433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:06.999433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:06.999433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:06.999433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:06.999433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:07.003688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 293/602] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:07.004393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46038040-2244-4bef-bdad-c075ccf37966 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:07.080420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d90c7-5297-47c4-8ba8-c4eae88a3845 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:07.111527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46038040-2244-4bef-bdad-c075ccf37966 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:07.121163 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076511-96fc-4cad-b7de-c61c3aefdb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:07.122210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076511-96fc-4cad-b7de-c61c3aefdb0d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:07.122755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076511-96fc-4cad-b7de-c61c3aefdb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:07.123286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076511-96fc-4cad-b7de-c61c3aefdb0d None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:07.124175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076511-96fc-4cad-b7de-c61c3aefdb0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:07.124692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076511-96fc-4cad-b7de-c61c3aefdb0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:07.126557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076511-96fc-4cad-b7de-c61c3aefdb0d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:07.140231 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 310/603] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:07.141312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076511-96fc-4cad-b7de-c61c3aefdb0d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:07.153230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94d4f6-c796-4774-b9c4-15a51a4ce2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:07.153837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94d4f6-c796-4774-b9c4-15a51a4ce2a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:07.154112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94d4f6-c796-4774-b9c4-15a51a4ce2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:07.154390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94d4f6-c796-4774-b9c4-15a51a4ce2a0 None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/c9cdd3fefd3f44eeaf19adbfac1ea13b/roles/c926095789574c45a0a5fd3f2a25262f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:07.172373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94d4f6-c796-4774-b9c4-15a51a4ce2a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=c9cdd3fefd3f44eeaf19adbfac1ea13b, role_id=c926095789574c45a0a5fd3f2a25262f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:07.174165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94d4f6-c796-4774-b9c4-15a51a4ce2a0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:07.197651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 294/604] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:59:07 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/c9cdd3fefd3f44eeaf19adbfac1ea13b/roles/c926095789574c45a0a5fd3f2a25262f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:59:07.197651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94d4f6-c796-4774-b9c4-15a51a4ce2a0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:07.260896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:07.268697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:07.336005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076511-96fc-4cad-b7de-c61c3aefdb0d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:07.380267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94d4f6-c796-4774-b9c4-15a51a4ce2a0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:07.381360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793de04-8bc8-461a-97b3-e3bc6174eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:07.382025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793de04-8bc8-461a-97b3-e3bc6174eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:07.382307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793de04-8bc8-461a-97b3-e3bc6174eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:07.382582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793de04-8bc8-461a-97b3-e3bc6174eeb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:07.383282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793de04-8bc8-461a-97b3-e3bc6174eeb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:07.383587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793de04-8bc8-461a-97b3-e3bc6174eeb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:07.385027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793de04-8bc8-461a-97b3-e3bc6174eeb4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:07.399578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 311/605] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:07.406763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793de04-8bc8-461a-97b3-e3bc6174eeb4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:07.452828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778c90a-90bd-4782-b9d3-2c101d2277c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:07.453966 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c90a-90bd-4782-b9d3-2c101d2277c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:07.454493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c90a-90bd-4782-b9d3-2c101d2277c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:07.455071 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c90a-90bd-4782-b9d3-2c101d2277c9 None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/4fe0dabaf0ef4fc7b417d378334413c6/roles/c926095789574c45a0a5fd3f2a25262f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:07.480627 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778c90a-90bd-4782-b9d3-2c101d2277c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=4fe0dabaf0ef4fc7b417d378334413c6, role_id=c926095789574c45a0a5fd3f2a25262f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:07.482198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778c90a-90bd-4782-b9d3-2c101d2277c9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:07.498900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 295/606] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:59:07 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/4fe0dabaf0ef4fc7b417d378334413c6/roles/c926095789574c45a0a5fd3f2a25262f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:59:07.532303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793de04-8bc8-461a-97b3-e3bc6174eeb4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:07.565783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:07.571182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3115a7-445b-4dd6-b043-162bc5c354f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:07.571858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3115a7-445b-4dd6-b043-162bc5c354f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:07.572184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3115a7-445b-4dd6-b043-162bc5c354f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:07.572468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3115a7-445b-4dd6-b043-162bc5c354f5 None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/3f20fbf033f04036b48194a804dae8c3/roles/c926095789574c45a0a5fd3f2a25262f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:07.599545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3115a7-445b-4dd6-b043-162bc5c354f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=3f20fbf033f04036b48194a804dae8c3, role_id=c926095789574c45a0a5fd3f2a25262f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:07.600931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3115a7-445b-4dd6-b043-162bc5c354f5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:07.627958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 312/607] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:59:07 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/3f20fbf033f04036b48194a804dae8c3/roles/c926095789574c45a0a5fd3f2a25262f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:59:07.836276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffefe7f-f753-47d5-8748-447a1b238abc None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:07.837031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffefe7f-f753-47d5-8748-447a1b238abc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:07.837568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffefe7f-f753-47d5-8748-447a1b238abc None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:07.839939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 296/608] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:07.847242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cf04f-b288-4ab7-bde4-803208b6213b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:07.847823 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cf04f-b288-4ab7-bde4-803208b6213b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:07.848566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cf04f-b288-4ab7-bde4-803208b6213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:07.869183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0b5cf04f-b288-4ab7-bde4-803208b6213b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:07.870762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0b5cf04f-b288-4ab7-bde4-803208b6213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:07.953353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 313/609] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:08.292386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffefe7f-f753-47d5-8748-447a1b238abc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:08.393593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:08.415096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffefe7f-f753-47d5-8748-447a1b238abc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:08.465409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5d258-7e9d-40b2-b5bf-dd8d13495905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:08.466069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5d258-7e9d-40b2-b5bf-dd8d13495905 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:08.466346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5d258-7e9d-40b2-b5bf-dd8d13495905 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:08.466617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5d258-7e9d-40b2-b5bf-dd8d13495905 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:08.481581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5d258-7e9d-40b2-b5bf-dd8d13495905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-45e5d258-7e9d-40b2-b5bf-dd8d13495905 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:08.486502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:08.487421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:08.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 297/610] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:08.498825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cf04f-b288-4ab7-bde4-803208b6213b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:08.648819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cf04f-b288-4ab7-bde4-803208b6213b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:08.668772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:08.700918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c2990-69e5-4a29-9416-25a9b84b269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:08.701547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c2990-69e5-4a29-9416-25a9b84b269d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:08.701852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c2990-69e5-4a29-9416-25a9b84b269d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:08.702128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c2990-69e5-4a29-9416-25a9b84b269d None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:08.702805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c2990-69e5-4a29-9416-25a9b84b269d None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:08.703114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c2990-69e5-4a29-9416-25a9b84b269d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:08.704499 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c2990-69e5-4a29-9416-25a9b84b269d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:08.718466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 314/611] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:08.724275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5d258-7e9d-40b2-b5bf-dd8d13495905 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:08.855438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e00a-8db5-4fc8-9463-4fc0477c3e34 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:08.855673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e00a-8db5-4fc8-9463-4fc0477c3e34 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:08.855904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e00a-8db5-4fc8-9463-4fc0477c3e34 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:08.857649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 315/612] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:08.863458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d497f2-9450-4407-a833-49c885c3dd44 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:08.863746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d497f2-9450-4407-a833-49c885c3dd44 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:08.864028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d497f2-9450-4407-a833-49c885c3dd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:08.883784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5d258-7e9d-40b2-b5bf-dd8d13495905 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:08.900477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-47d497f2-9450-4407-a833-49c885c3dd44 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:08.903520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-47d497f2-9450-4407-a833-49c885c3dd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:08.953018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bad43d-7897-4f76-8227-77b15b393a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:08.954020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bad43d-7897-4f76-8227-77b15b393a91 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:08.955117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bad43d-7897-4f76-8227-77b15b393a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:08.955533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bad43d-7897-4f76-8227-77b15b393a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:08.973422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:08.977981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bad43d-7897-4f76-8227-77b15b393a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:08.980931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bad43d-7897-4f76-8227-77b15b393a91 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:09.005883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 316/613] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c9bad43d-7897-4f76-8227-77b15b393a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:09.008812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:09.009921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:09.011143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:09.011143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:09.011143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:09.012847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 298/614] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:09.018142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d497f2-9450-4407-a833-49c885c3dd44 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:09.202551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d497f2-9450-4407-a833-49c885c3dd44 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:09.210599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:09.250413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d2768-bc6f-4c54-ad24-d40197c55327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:09.251020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d2768-bc6f-4c54-ad24-d40197c55327 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:09.251300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d2768-bc6f-4c54-ad24-d40197c55327 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:09.251573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d2768-bc6f-4c54-ad24-d40197c55327 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:09.252209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d2768-bc6f-4c54-ad24-d40197c55327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:09.252508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d2768-bc6f-4c54-ad24-d40197c55327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:09.253894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d2768-bc6f-4c54-ad24-d40197c55327 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:09.265316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 317/615] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:09.270521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bad43d-7897-4f76-8227-77b15b393a91 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:09.315517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d2768-bc6f-4c54-ad24-d40197c55327 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:09.427305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bad43d-7897-4f76-8227-77b15b393a91 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:09.467413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5a014-72be-478f-90b5-d98e777efe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:09.467974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5a014-72be-478f-90b5-d98e777efe5d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:09.468400 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5a014-72be-478f-90b5-d98e777efe5d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:09.468681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5a014-72be-478f-90b5-d98e777efe5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:09.477124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5a014-72be-478f-90b5-d98e777efe5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:09.479467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5a014-72be-478f-90b5-d98e777efe5d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-97e5a014-72be-478f-90b5-d98e777efe5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:09.492698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:09.493634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:09.494794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 299/616] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:09.499751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5a014-72be-478f-90b5-d98e777efe5d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:09.541924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d2768-bc6f-4c54-ad24-d40197c55327 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:09.594652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:09.615482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2e25-957f-4136-9db1-f4ffcb818e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:09.616131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2e25-957f-4136-9db1-f4ffcb818e34 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:09.616411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2e25-957f-4136-9db1-f4ffcb818e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:09.616695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2e25-957f-4136-9db1-f4ffcb818e34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:09.643724 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb2e25-957f-4136-9db1-f4ffcb818e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-75eb2e25-957f-4136-9db1-f4ffcb818e34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:09.653427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:09.655593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:09.657647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 318/617] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:09.665833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2e25-957f-4136-9db1-f4ffcb818e34 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:09.703157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5a014-72be-478f-90b5-d98e777efe5d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:09.726245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:09.778029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7742eec-12e7-4d22-8aa6-891396d4a18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:09.778638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7742eec-12e7-4d22-8aa6-891396d4a18c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:09.778924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7742eec-12e7-4d22-8aa6-891396d4a18c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:09.779200 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7742eec-12e7-4d22-8aa6-891396d4a18c None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:09.779933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7742eec-12e7-4d22-8aa6-891396d4a18c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:09.780240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7742eec-12e7-4d22-8aa6-891396d4a18c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:09.786180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7742eec-12e7-4d22-8aa6-891396d4a18c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:09.827879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 300/618] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 19 11:59:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:09.833045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7742eec-12e7-4d22-8aa6-891396d4a18c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:09.884170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2e25-957f-4136-9db1-f4ffcb818e34 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:09.961909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d81c4-427e-4a1a-9029-de55ffe9e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:09.962523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d81c4-427e-4a1a-9029-de55ffe9e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:09.962804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d81c4-427e-4a1a-9029-de55ffe9e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:09.963073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d81c4-427e-4a1a-9029-de55ffe9e4f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:09.963733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d81c4-427e-4a1a-9029-de55ffe9e4f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:09.964064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d81c4-427e-4a1a-9029-de55ffe9e4f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:09.965427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d81c4-427e-4a1a-9029-de55ffe9e4f4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:09.988932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 319/619] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:09.994661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d81c4-427e-4a1a-9029-de55ffe9e4f4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:10.032766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7742eec-12e7-4d22-8aa6-891396d4a18c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:10.048172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:10.080457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34ea45-98a8-4cd7-a7a3-4a8d82ac36c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:10.081196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34ea45-98a8-4cd7-a7a3-4a8d82ac36c5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.081604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34ea45-98a8-4cd7-a7a3-4a8d82ac36c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.081970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34ea45-98a8-4cd7-a7a3-4a8d82ac36c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.096118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34ea45-98a8-4cd7-a7a3-4a8d82ac36c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:10.098971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34ea45-98a8-4cd7-a7a3-4a8d82ac36c5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:10.101509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:10.119422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d81c4-427e-4a1a-9029-de55ffe9e4f4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ca34ea45-98a8-4cd7-a7a3-4a8d82ac36c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:10.126028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:10.127932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:10.129079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:10.129079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:10.129079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:10.129079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 301/620] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:10.132826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2db41b-6342-4494-a347-05fae675c20d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.132826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2db41b-6342-4494-a347-05fae675c20d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.132826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2db41b-6342-4494-a347-05fae675c20d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.133279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 302/621] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:10.133895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2db41b-6342-4494-a347-05fae675c20d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:10.161149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d41d1-26bf-4f9c-a86d-f45b61c89245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:10.161941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d41d1-26bf-4f9c-a86d-f45b61c89245 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.162287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d41d1-26bf-4f9c-a86d-f45b61c89245 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.162647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d41d1-26bf-4f9c-a86d-f45b61c89245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.175742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d41d1-26bf-4f9c-a86d-f45b61c89245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:10.177359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d41d1-26bf-4f9c-a86d-f45b61c89245 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-984d41d1-26bf-4f9c-a86d-f45b61c89245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:10.194613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:10.196203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:10.197445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:10.197445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:10.197445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:10.197445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 320/622] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:10.199476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc92a7-833c-490f-b2f8-546f56187695 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.202972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc92a7-833c-490f-b2f8-546f56187695 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.202972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc92a7-833c-490f-b2f8-546f56187695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.218716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3ffc92a7-833c-490f-b2f8-546f56187695 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:10.219998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3ffc92a7-833c-490f-b2f8-546f56187695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:10.268145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2db41b-6342-4494-a347-05fae675c20d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:10.303346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 321/623] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:10.304185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc92a7-833c-490f-b2f8-546f56187695 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:10.310176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99978b12-561a-41d1-99be-f4f4a798867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:10.310789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978b12-561a-41d1-99be-f4f4a798867c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.311065 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978b12-561a-41d1-99be-f4f4a798867c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.311333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978b12-561a-41d1-99be-f4f4a798867c None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.311973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99978b12-561a-41d1-99be-f4f4a798867c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:10.312273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99978b12-561a-41d1-99be-f4f4a798867c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:10.313792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99978b12-561a-41d1-99be-f4f4a798867c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:10.325877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 303/624] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:10.327179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af089f9f-cc08-4287-b39e-e5b48ef54ad1 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.327463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af089f9f-cc08-4287-b39e-e5b48ef54ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.327732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af089f9f-cc08-4287-b39e-e5b48ef54ad1 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.329065 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 304/625] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:10.335490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8c493-a1e3-4819-8f53-a8705b7ec0fa None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.335953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8c493-a1e3-4819-8f53-a8705b7ec0fa None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.336305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8c493-a1e3-4819-8f53-a8705b7ec0fa None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.338056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 305/626] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:10.338827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8c493-a1e3-4819-8f53-a8705b7ec0fa None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:10.365916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:10.386372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:10.423982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc92a7-833c-490f-b2f8-546f56187695 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:10.445965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8c493-a1e3-4819-8f53-a8705b7ec0fa None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:10.460797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21ed24-5a48-4a3a-8331-b0c43f54c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:10.461403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21ed24-5a48-4a3a-8331-b0c43f54c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.461715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21ed24-5a48-4a3a-8331-b0c43f54c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.461988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21ed24-5a48-4a3a-8331-b0c43f54c2e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.462622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21ed24-5a48-4a3a-8331-b0c43f54c2e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:10.462925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21ed24-5a48-4a3a-8331-b0c43f54c2e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:10.464412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21ed24-5a48-4a3a-8331-b0c43f54c2e4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:10.476488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 322/627] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:10.477476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767ab90-207b-41f0-ab25-008140eee52f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.477821 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767ab90-207b-41f0-ab25-008140eee52f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.478087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767ab90-207b-41f0-ab25-008140eee52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.486994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017e5be-8a78-495b-8ef4-426509936193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:10.487616 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e5be-8a78-495b-8ef4-426509936193 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.487892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e5be-8a78-495b-8ef4-426509936193 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.488156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e5be-8a78-495b-8ef4-426509936193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.495521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017e5be-8a78-495b-8ef4-426509936193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:10.496515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2767ab90-207b-41f0-ab25-008140eee52f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:10.497200 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017e5be-8a78-495b-8ef4-426509936193 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:10.497727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2767ab90-207b-41f0-ab25-008140eee52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3017e5be-8a78-495b-8ef4-426509936193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:10.508484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:10.509384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:10.510302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:10.510302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:10.510302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:10.510302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:10.510302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:10.510302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:10.510302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:10.510302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:10.510302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 306/628] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:10.510798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8ad4-7580-4ae1-baf3-15c94abd6ede None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.511894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8ad4-7580-4ae1-baf3-15c94abd6ede None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.512110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8ad4-7580-4ae1-baf3-15c94abd6ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.530217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-325b8ad4-7580-4ae1-baf3-15c94abd6ede None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:10.531302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-325b8ad4-7580-4ae1-baf3-15c94abd6ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:10.571882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 323/629] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:10.572768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767ab90-207b-41f0-ab25-008140eee52f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:10.598405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 307/630] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:10.599302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8ad4-7580-4ae1-baf3-15c94abd6ede None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:10.613248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:10.656010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:10.712412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767ab90-207b-41f0-ab25-008140eee52f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:10.737334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8ad4-7580-4ae1-baf3-15c94abd6ede None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:10.753648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd091de3-b846-4380-a1e4-be5b5e10a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:10.754505 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd091de3-b846-4380-a1e4-be5b5e10a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.754938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd091de3-b846-4380-a1e4-be5b5e10a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.755350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd091de3-b846-4380-a1e4-be5b5e10a6c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.763594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd091de3-b846-4380-a1e4-be5b5e10a6c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:10.765202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd091de3-b846-4380-a1e4-be5b5e10a6c9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:10.771511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24381e51-f557-466d-b6b4-979602329427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:10.772127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24381e51-f557-466d-b6b4-979602329427 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.772410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24381e51-f557-466d-b6b4-979602329427 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.772686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24381e51-f557-466d-b6b4-979602329427 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.773373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24381e51-f557-466d-b6b4-979602329427 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:10.773719 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24381e51-f557-466d-b6b4-979602329427 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:10.775247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24381e51-f557-466d-b6b4-979602329427 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cd091de3-b846-4380-a1e4-be5b5e10a6c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:10.781136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:10.782235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:10.783249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:10.783249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:10.783249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:10.783249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:10.783249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:10.783249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:10.783249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:10.783249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:10.783249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:59:10.783249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:10.785227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 324/631] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 19 11:59:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:10.786252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd091de3-b846-4380-a1e4-be5b5e10a6c9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:10.792891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 308/632] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:10.793822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24381e51-f557-466d-b6b4-979602329427 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:10.873347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:10.904087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd091de3-b846-4380-a1e4-be5b5e10a6c9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:10.908235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24381e51-f557-466d-b6b4-979602329427 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:10.921198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:10.937932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49eefc-7b66-46bf-8247-063cb65da39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:10.938557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49eefc-7b66-46bf-8247-063cb65da39f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.938836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49eefc-7b66-46bf-8247-063cb65da39f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.939106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49eefc-7b66-46bf-8247-063cb65da39f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.941763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868860d9-9deb-4776-ade5-c5443714cdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:10.942391 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868860d9-9deb-4776-ade5-c5443714cdff None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:10.942674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868860d9-9deb-4776-ade5-c5443714cdff None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:10.942951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868860d9-9deb-4776-ade5-c5443714cdff None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:10.943674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868860d9-9deb-4776-ade5-c5443714cdff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:10.943984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868860d9-9deb-4776-ade5-c5443714cdff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:10.945437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868860d9-9deb-4776-ade5-c5443714cdff None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:10.949353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49eefc-7b66-46bf-8247-063cb65da39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5f49eefc-7b66-46bf-8247-063cb65da39f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:10.954578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:10.955679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 325/633] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:10.959402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49eefc-7b66-46bf-8247-063cb65da39f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:10.968981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 309/634] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 19 11:59:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:10.970054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868860d9-9deb-4776-ade5-c5443714cdff None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:11.055200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49eefc-7b66-46bf-8247-063cb65da39f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:11.069456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868860d9-9deb-4776-ade5-c5443714cdff None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:11.090361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c8176-4fe0-4657-8145-63f71c636836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:11.091019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c8176-4fe0-4657-8145-63f71c636836 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:11.091303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c8176-4fe0-4657-8145-63f71c636836 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:11.091585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c8176-4fe0-4657-8145-63f71c636836 None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/7b33b44f0e354c16846dd87179131141/roles/c926095789574c45a0a5fd3f2a25262f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:11.098797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.104941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561af6-86ce-4921-b778-a435bd0c299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:11.105673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561af6-86ce-4921-b778-a435bd0c299d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:11.105956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561af6-86ce-4921-b778-a435bd0c299d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:11.106248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561af6-86ce-4921-b778-a435bd0c299d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:11.106556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c8176-4fe0-4657-8145-63f71c636836 None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=7b33b44f0e354c16846dd87179131141, role_id=c926095789574c45a0a5fd3f2a25262f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:11.107987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c8176-4fe0-4657-8145-63f71c636836 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:11.116248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f561af6-86ce-4921-b778-a435bd0c299d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:11.129981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 326/635] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:59:10 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/7b33b44f0e354c16846dd87179131141/roles/c926095789574c45a0a5fd3f2a25262f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:59:11.129981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c8176-4fe0-4657-8145-63f71c636836 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1f561af6-86ce-4921-b778-a435bd0c299d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:11.130302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:11.131338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 310/636] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:11.132383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561af6-86ce-4921-b778-a435bd0c299d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:11.167830 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.249915 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c8176-4fe0-4657-8145-63f71c636836 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:11.250852 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561af6-86ce-4921-b778-a435bd0c299d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:11.290035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4dc6-ae9d-4988-8737-f1cb47f01762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:11.290957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4dc6-ae9d-4988-8737-f1cb47f01762 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:11.291408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4dc6-ae9d-4988-8737-f1cb47f01762 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:11.291851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4dc6-ae9d-4988-8737-f1cb47f01762 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:11.292994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e4dc6-ae9d-4988-8737-f1cb47f01762 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:11.293452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e4dc6-ae9d-4988-8737-f1cb47f01762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:11.294988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e4dc6-ae9d-4988-8737-f1cb47f01762 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:11.297363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34770eab-642d-4af6-9315-d0d8c004347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:11.298552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34770eab-642d-4af6-9315-d0d8c004347b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:11.298986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34770eab-642d-4af6-9315-d0d8c004347b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:11.299372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34770eab-642d-4af6-9315-d0d8c004347b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:11.304636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 311/637] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:11.305743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4dc6-ae9d-4988-8737-f1cb47f01762 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:11.314579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34770eab-642d-4af6-9315-d0d8c004347b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-34770eab-642d-4af6-9315-d0d8c004347b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:11.319746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:11.320857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:11.321872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:11.328250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 327/638] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:11.329894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34770eab-642d-4af6-9315-d0d8c004347b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:11.360901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.411174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4dc6-ae9d-4988-8737-f1cb47f01762 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:11.422727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.435212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34770eab-642d-4af6-9315-d0d8c004347b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:11.448698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41edaf-911f-4171-8c11-53be90fcd4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:11.449991 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41edaf-911f-4171-8c11-53be90fcd4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:11.450415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41edaf-911f-4171-8c11-53be90fcd4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:11.450828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41edaf-911f-4171-8c11-53be90fcd4b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:11.470792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb93e7-b0d3-45cf-aa58-ab50390db907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:11.471402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb93e7-b0d3-45cf-aa58-ab50390db907 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:11.471974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb93e7-b0d3-45cf-aa58-ab50390db907 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:11.472260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb93e7-b0d3-45cf-aa58-ab50390db907 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:11.472923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb93e7-b0d3-45cf-aa58-ab50390db907 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:11.473488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb93e7-b0d3-45cf-aa58-ab50390db907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:11.474886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb93e7-b0d3-45cf-aa58-ab50390db907 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:11.484372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 328/639] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:11.485301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb93e7-b0d3-45cf-aa58-ab50390db907 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:11.527950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41edaf-911f-4171-8c11-53be90fcd4b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:11.529692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41edaf-911f-4171-8c11-53be90fcd4b5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:11.587037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.591757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb93e7-b0d3-45cf-aa58-ab50390db907 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:11.629378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a0511-af94-4357-b162-244f9de75264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:11.630148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a0511-af94-4357-b162-244f9de75264 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:11.630429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a0511-af94-4357-b162-244f9de75264 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:11.630940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a0511-af94-4357-b162-244f9de75264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:11.641153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 312/640] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:11.641153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41edaf-911f-4171-8c11-53be90fcd4b5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:11.645941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a0511-af94-4357-b162-244f9de75264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:11.647590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a0511-af94-4357-b162-244f9de75264 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0a7a0511-af94-4357-b162-244f9de75264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:11.666974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:11.668525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:11.669399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:11.669399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:11.669399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:11.670262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 329/641] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:11.670627 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a0511-af94-4357-b162-244f9de75264 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:11.675780 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.756728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41edaf-911f-4171-8c11-53be90fcd4b5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:11.794939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0c3b-9243-4a50-982a-b054e39ce31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:11.795497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a0511-af94-4357-b162-244f9de75264 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:11.796079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0c3b-9243-4a50-982a-b054e39ce31c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:11.796548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0c3b-9243-4a50-982a-b054e39ce31c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:11.796996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0c3b-9243-4a50-982a-b054e39ce31c None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:11.797881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0c3b-9243-4a50-982a-b054e39ce31c None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:11.798374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0c3b-9243-4a50-982a-b054e39ce31c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:11.799815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0c3b-9243-4a50-982a-b054e39ce31c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:11.813641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 313/642] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:11.814626 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0c3b-9243-4a50-982a-b054e39ce31c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:11.831931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1234482-7726-4bef-bf39-12dbbba1f96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:11.832893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1234482-7726-4bef-bf39-12dbbba1f96b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:11.833420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1234482-7726-4bef-bf39-12dbbba1f96b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:11.833918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1234482-7726-4bef-bf39-12dbbba1f96b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:11.837105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.854057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1234482-7726-4bef-bf39-12dbbba1f96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:11.857858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1234482-7726-4bef-bf39-12dbbba1f96b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b1234482-7726-4bef-bf39-12dbbba1f96b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:11.879176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:11.880460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:11.881543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:11.881543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:11.881543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:11.886572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 330/643] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:11.887490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1234482-7726-4bef-bf39-12dbbba1f96b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:11.944186 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0c3b-9243-4a50-982a-b054e39ce31c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:11.950634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.986723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9f576-7d38-4984-874c-0d818924a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:11.987506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f576-7d38-4984-874c-0d818924a14b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:11.987880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f576-7d38-4984-874c-0d818924a14b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:11.988245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f576-7d38-4984-874c-0d818924a14b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:11.999194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9f576-7d38-4984-874c-0d818924a14b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.000965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9f576-7d38-4984-874c-0d818924a14b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.006617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1234482-7726-4bef-bf39-12dbbba1f96b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a9a9f576-7d38-4984-874c-0d818924a14b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:12.025114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:12.026363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:12.028287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:12.028287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:12.028287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:12.034021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 314/644] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:12.034021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9f576-7d38-4984-874c-0d818924a14b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.059646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7fa7-a919-46b0-a030-d5fc80446e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.060914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7fa7-a919-46b0-a030-d5fc80446e26 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.061398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7fa7-a919-46b0-a030-d5fc80446e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.062170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7fa7-a919-46b0-a030-d5fc80446e26 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.062990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d7fa7-a919-46b0-a030-d5fc80446e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:12.063296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d7fa7-a919-46b0-a030-d5fc80446e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.064662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d7fa7-a919-46b0-a030-d5fc80446e26 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.082364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 331/645] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:12.082364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7fa7-a919-46b0-a030-d5fc80446e26 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.119745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:12.166145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9f576-7d38-4984-874c-0d818924a14b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.192121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7fa7-a919-46b0-a030-d5fc80446e26 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.202096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c83634-146b-47ee-9922-f14894b36897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.202836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83634-146b-47ee-9922-f14894b36897 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.203210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83634-146b-47ee-9922-f14894b36897 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.203581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83634-146b-47ee-9922-f14894b36897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.208256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:12.214849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c83634-146b-47ee-9922-f14894b36897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.216392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c83634-146b-47ee-9922-f14894b36897 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.231595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9984a-36f2-429e-99dd-c63a700b0cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.232194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9984a-36f2-429e-99dd-c63a700b0cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.232472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9984a-36f2-429e-99dd-c63a700b0cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.232744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9984a-36f2-429e-99dd-c63a700b0cd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-52c83634-146b-47ee-9922-f14894b36897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:12.233078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:12.234177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:12.235250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:12.235250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:12.235250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:12.235463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9984a-36f2-429e-99dd-c63a700b0cd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:12.235463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9984a-36f2-429e-99dd-c63a700b0cd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.235463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9984a-36f2-429e-99dd-c63a700b0cd8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.241722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 315/646] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:12.241722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c83634-146b-47ee-9922-f14894b36897 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.257583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 332/647] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:12.257583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9984a-36f2-429e-99dd-c63a700b0cd8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.350937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c83634-146b-47ee-9922-f14894b36897 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.361584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9984a-36f2-429e-99dd-c63a700b0cd8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.372234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:12.392638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8f53-5a22-4152-b641-402c92f67d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.393252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8f53-5a22-4152-b641-402c92f67d63 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.393533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8f53-5a22-4152-b641-402c92f67d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.393826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8f53-5a22-4152-b641-402c92f67d63 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.394470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a8f53-5a22-4152-b641-402c92f67d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:12.394773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a8f53-5a22-4152-b641-402c92f67d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.396141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a8f53-5a22-4152-b641-402c92f67d63 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.399762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ca200-e394-4f88-b029-3ae9a079989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.400394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ca200-e394-4f88-b029-3ae9a079989d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.400670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ca200-e394-4f88-b029-3ae9a079989d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.401005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ca200-e394-4f88-b029-3ae9a079989d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.413332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 316/648] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:12.413332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8f53-5a22-4152-b641-402c92f67d63 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.414986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ca200-e394-4f88-b029-3ae9a079989d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.418345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ca200-e394-4f88-b029-3ae9a079989d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-021ca200-e394-4f88-b029-3ae9a079989d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:12.431113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:12.432238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 333/649] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:12.433738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ca200-e394-4f88-b029-3ae9a079989d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.477416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:12.519974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8f53-5a22-4152-b641-402c92f67d63 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.546528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ca200-e394-4f88-b029-3ae9a079989d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.563724 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c7d6d-a7fd-4e4f-ad74-9e2ea12b1958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.564333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c7d6d-a7fd-4e4f-ad74-9e2ea12b1958 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.564611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c7d6d-a7fd-4e4f-ad74-9e2ea12b1958 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.564885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c7d6d-a7fd-4e4f-ad74-9e2ea12b1958 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.565516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c7d6d-a7fd-4e4f-ad74-9e2ea12b1958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:12.565856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c7d6d-a7fd-4e4f-ad74-9e2ea12b1958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.567236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c7d6d-a7fd-4e4f-ad74-9e2ea12b1958 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.582865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 317/650] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:12.582865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c7d6d-a7fd-4e4f-ad74-9e2ea12b1958 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.583102 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcaa86-a7d3-4a05-8456-f39fbd668f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.583963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcaa86-a7d3-4a05-8456-f39fbd668f73 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.584305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcaa86-a7d3-4a05-8456-f39fbd668f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.584625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcaa86-a7d3-4a05-8456-f39fbd668f73 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.594414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcaa86-a7d3-4a05-8456-f39fbd668f73 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.595845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcaa86-a7d3-4a05-8456-f39fbd668f73 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-07bcaa86-a7d3-4a05-8456-f39fbd668f73 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:12.608652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:12.610182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:12.611141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:12.611141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:12.611141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:12.611141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:12.611141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:12.611141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:12.611141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:12.611141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:12.611141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:59:12.611141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:12.614729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 334/651] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:12.615495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcaa86-a7d3-4a05-8456-f39fbd668f73 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.624819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:12.688047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c7d6d-a7fd-4e4f-ad74-9e2ea12b1958 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.722212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa8bb3-37ec-48e5-815d-df6fc7a4d391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.722844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa8bb3-37ec-48e5-815d-df6fc7a4d391 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.723372 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa8bb3-37ec-48e5-815d-df6fc7a4d391 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.723640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa8bb3-37ec-48e5-815d-df6fc7a4d391 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.724198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:12.731222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa8bb3-37ec-48e5-815d-df6fc7a4d391 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.732662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa8bb3-37ec-48e5-815d-df6fc7a4d391 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.732965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcaa86-a7d3-4a05-8456-f39fbd668f73 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-97aa8bb3-37ec-48e5-815d-df6fc7a4d391 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:12.744370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:12.745926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:12.746911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:12.746911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:12.746911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:12.746911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:12.746911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:12.746911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:12.746911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:12.746911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:12.746911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 318/652] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:12.747400 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa8bb3-37ec-48e5-815d-df6fc7a4d391 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.777359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc6267-62ea-4cd9-bd72-40f76e2a163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.778172 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6267-62ea-4cd9-bd72-40f76e2a163f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.778409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6267-62ea-4cd9-bd72-40f76e2a163f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.778685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6267-62ea-4cd9-bd72-40f76e2a163f None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.779455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc6267-62ea-4cd9-bd72-40f76e2a163f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:12.779713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc6267-62ea-4cd9-bd72-40f76e2a163f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.781141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc6267-62ea-4cd9-bd72-40f76e2a163f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.800853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 335/653] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:12.802694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc6267-62ea-4cd9-bd72-40f76e2a163f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.852927 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:12.858144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa8bb3-37ec-48e5-815d-df6fc7a4d391 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.895900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79434-aec7-4f84-991a-80c96db8f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.896550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79434-aec7-4f84-991a-80c96db8f402 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.896822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79434-aec7-4f84-991a-80c96db8f402 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.897096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79434-aec7-4f84-991a-80c96db8f402 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.905355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc6267-62ea-4cd9-bd72-40f76e2a163f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:12.905688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f79434-aec7-4f84-991a-80c96db8f402 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.907304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f79434-aec7-4f84-991a-80c96db8f402 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c1f79434-aec7-4f84-991a-80c96db8f402 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:12.919919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:12.920882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 319/654] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:12.921874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79434-aec7-4f84-991a-80c96db8f402 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.942737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070629c-9e5b-42ea-83f1-ba13a62fc050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:12.943348 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070629c-9e5b-42ea-83f1-ba13a62fc050 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.943623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070629c-9e5b-42ea-83f1-ba13a62fc050 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.943890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070629c-9e5b-42ea-83f1-ba13a62fc050 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.944608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070629c-9e5b-42ea-83f1-ba13a62fc050 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:12.944934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070629c-9e5b-42ea-83f1-ba13a62fc050 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:12.946397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070629c-9e5b-42ea-83f1-ba13a62fc050 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:12.972223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 336/655] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:12.972223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070629c-9e5b-42ea-83f1-ba13a62fc050 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:12.986887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:13.029569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79434-aec7-4f84-991a-80c96db8f402 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:13.064974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a5165-b6d2-42c3-aa58-d7cc10431cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:13.065950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5165-b6d2-42c3-aa58-d7cc10431cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.066481 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5165-b6d2-42c3-aa58-d7cc10431cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.066814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5165-b6d2-42c3-aa58-d7cc10431cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.067562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a5165-b6d2-42c3-aa58-d7cc10431cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:13.067871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a5165-b6d2-42c3-aa58-d7cc10431cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:13.069362 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a5165-b6d2-42c3-aa58-d7cc10431cf9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:13.082616 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 320/656] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:13.083013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070629c-9e5b-42ea-83f1-ba13a62fc050 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:13.083693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a5165-b6d2-42c3-aa58-d7cc10431cf9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:13.108007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:13.123783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3000-5e4f-4bd1-b402-1e07d9f0393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:13.124399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3000-5e4f-4bd1-b402-1e07d9f0393b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.124681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3000-5e4f-4bd1-b402-1e07d9f0393b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.124961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3000-5e4f-4bd1-b402-1e07d9f0393b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.194242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a5165-b6d2-42c3-aa58-d7cc10431cf9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:13.196031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f3000-5e4f-4bd1-b402-1e07d9f0393b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:13.197521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f3000-5e4f-4bd1-b402-1e07d9f0393b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:13.211863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:13.235956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1991b-e8df-4ebf-8dd7-99788e417091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:13.236565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1991b-e8df-4ebf-8dd7-99788e417091 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.236845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1991b-e8df-4ebf-8dd7-99788e417091 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.237109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1991b-e8df-4ebf-8dd7-99788e417091 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.238073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1991b-e8df-4ebf-8dd7-99788e417091 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:13.238183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1991b-e8df-4ebf-8dd7-99788e417091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:13.239552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1991b-e8df-4ebf-8dd7-99788e417091 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:13.262592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 321/657] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 19 11:59:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:13.262592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1991b-e8df-4ebf-8dd7-99788e417091 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:13.310801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 337/658] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:13.311879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3000-5e4f-4bd1-b402-1e07d9f0393b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:13.346103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:13.369140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1991b-e8df-4ebf-8dd7-99788e417091 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:13.404645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdb762-57b8-4867-b308-337e095fa6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:13.405328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdb762-57b8-4867-b308-337e095fa6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.405700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdb762-57b8-4867-b308-337e095fa6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.405976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdb762-57b8-4867-b308-337e095fa6a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.413234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3000-5e4f-4bd1-b402-1e07d9f0393b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:13.424630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:13.447519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff24f0d-2a07-4db0-afd4-90e16cf51fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:13.448048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff24f0d-2a07-4db0-afd4-90e16cf51fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.448899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff24f0d-2a07-4db0-afd4-90e16cf51fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.449229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff24f0d-2a07-4db0-afd4-90e16cf51fa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.450115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff24f0d-2a07-4db0-afd4-90e16cf51fa4 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=02430b0097f94fa0a2015480a6ec68eb) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:13.450423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff24f0d-2a07-4db0-afd4-90e16cf51fa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:13.451845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff24f0d-2a07-4db0-afd4-90e16cf51fa4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:13.457391 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 338/659] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:13 2022] GET /identity/v3/role_assignments?user.id=02430b0097f94fa0a2015480a6ec68eb&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:13.458188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff24f0d-2a07-4db0-afd4-90e16cf51fa4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:13.473386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdb762-57b8-4867-b308-337e095fa6a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:13.474991 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdb762-57b8-4867-b308-337e095fa6a8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:13.555845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:13.572074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff24f0d-2a07-4db0-afd4-90e16cf51fa4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:13.587334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 322/660] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:13.587334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdb762-57b8-4867-b308-337e095fa6a8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:13.618739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd016e-a28a-403a-905c-7c8822d7d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:13.619364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd016e-a28a-403a-905c-7c8822d7d152 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.619623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd016e-a28a-403a-905c-7c8822d7d152 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.619892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd016e-a28a-403a-905c-7c8822d7d152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.673278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:13.710091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdb762-57b8-4867-b308-337e095fa6a8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:13.710439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd016e-a28a-403a-905c-7c8822d7d152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:13.711943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd016e-a28a-403a-905c-7c8822d7d152 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:13.748012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc164934-6221-4951-933b-77a97a4c86e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:13.748642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc164934-6221-4951-933b-77a97a4c86e9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.748921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc164934-6221-4951-933b-77a97a4c86e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.749195 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc164934-6221-4951-933b-77a97a4c86e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.759848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc164934-6221-4951-933b-77a97a4c86e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:13.761603 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc164934-6221-4951-933b-77a97a4c86e9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-fc164934-6221-4951-933b-77a97a4c86e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:13.777969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:13.779123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:13.780166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:13.780166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:13.780166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:13.780166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 323/661] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:13.782871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d41a6-daff-4dde-bdaa-34b3a809d49a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.783161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d41a6-daff-4dde-bdaa-34b3a809d49a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.783442 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d41a6-daff-4dde-bdaa-34b3a809d49a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.784732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 324/662] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:13.785439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d41a6-daff-4dde-bdaa-34b3a809d49a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:13.815384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:13.824728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 339/663] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:13.825670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd016e-a28a-403a-905c-7c8822d7d152 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:13.893433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d41a6-daff-4dde-bdaa-34b3a809d49a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:13.908317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:13.928844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ecbeb-c36f-425f-8ac5-c55f4cdab39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:13.929470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ecbeb-c36f-425f-8ac5-c55f4cdab39a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.929783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ecbeb-c36f-425f-8ac5-c55f4cdab39a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.930072 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ecbeb-c36f-425f-8ac5-c55f4cdab39a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.934924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd016e-a28a-403a-905c-7c8822d7d152 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:13.941536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ecbeb-c36f-425f-8ac5-c55f4cdab39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:13.943114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ecbeb-c36f-425f-8ac5-c55f4cdab39a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-345ecbeb-c36f-425f-8ac5-c55f4cdab39a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:13.957503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:13.958489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:13.959371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:13.959371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:13.959371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:13.959371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 325/664] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:13.960187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39055e1a-8b7d-4f52-87cb-1f5f0375244f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.960187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39055e1a-8b7d-4f52-87cb-1f5f0375244f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.960343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39055e1a-8b7d-4f52-87cb-1f5f0375244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.977394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21701e06-e029-459f-82a2-f5d66de57248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:13.978038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21701e06-e029-459f-82a2-f5d66de57248 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:13.978320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21701e06-e029-459f-82a2-f5d66de57248 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:13.978594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21701e06-e029-459f-82a2-f5d66de57248 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:13.979235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21701e06-e029-459f-82a2-f5d66de57248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:13.979443 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-39055e1a-8b7d-4f52-87cb-1f5f0375244f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:13.979616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21701e06-e029-459f-82a2-f5d66de57248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:13.981451 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21701e06-e029-459f-82a2-f5d66de57248 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:13.981572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-39055e1a-8b7d-4f52-87cb-1f5f0375244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:13.993958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 340/665] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:13.994800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21701e06-e029-459f-82a2-f5d66de57248 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.061047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 326/666] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:14.061930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39055e1a-8b7d-4f52-87cb-1f5f0375244f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.082429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:14.105249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21701e06-e029-459f-82a2-f5d66de57248 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.140912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb59a6c-55be-4a97-94a0-05157c740bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.142317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb59a6c-55be-4a97-94a0-05157c740bbe None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.143266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb59a6c-55be-4a97-94a0-05157c740bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.143545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb59a6c-55be-4a97-94a0-05157c740bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.146566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:14.158253 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb59a6c-55be-4a97-94a0-05157c740bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:14.159986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb59a6c-55be-4a97-94a0-05157c740bbe None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1bb59a6c-55be-4a97-94a0-05157c740bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:14.174465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:14.175429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:14.176304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:14.176304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:14.176304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:14.176304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 341/667] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:14.177110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb59a6c-55be-4a97-94a0-05157c740bbe None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.195130 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39055e1a-8b7d-4f52-87cb-1f5f0375244f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.232783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b03609-afff-4fb6-a3b5-5528617c0238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.233766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b03609-afff-4fb6-a3b5-5528617c0238 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.234276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b03609-afff-4fb6-a3b5-5528617c0238 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.234754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b03609-afff-4fb6-a3b5-5528617c0238 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.235612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b03609-afff-4fb6-a3b5-5528617c0238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:14.236120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b03609-afff-4fb6-a3b5-5528617c0238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:14.237731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b03609-afff-4fb6-a3b5-5528617c0238 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:14.253948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 327/668] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:14.255131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b03609-afff-4fb6-a3b5-5528617c0238 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.283523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb59a6c-55be-4a97-94a0-05157c740bbe None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.318981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d7f5a-e56f-4310-a645-23f2d3fd316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.319613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d7f5a-e56f-4310-a645-23f2d3fd316d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.319890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d7f5a-e56f-4310-a645-23f2d3fd316d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.320160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d7f5a-e56f-4310-a645-23f2d3fd316d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.327584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d7f5a-e56f-4310-a645-23f2d3fd316d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:14.329021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d7f5a-e56f-4310-a645-23f2d3fd316d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:14.332061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3f4d7f5a-e56f-4310-a645-23f2d3fd316d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:14.341778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:14.342705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:14.343582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:14.343582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:14.343582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:14.343582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:14.343582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:14.343582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:14.343582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:14.343582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:14.347659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 342/669] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:14.348642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d7f5a-e56f-4310-a645-23f2d3fd316d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.371742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b03609-afff-4fb6-a3b5-5528617c0238 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.398934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:14.409704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b6d15-be30-4ad0-8568-edd6dc97d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.410321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b6d15-be30-4ad0-8568-edd6dc97d623 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.410600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b6d15-be30-4ad0-8568-edd6dc97d623 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.410871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b6d15-be30-4ad0-8568-edd6dc97d623 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.411511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b6d15-be30-4ad0-8568-edd6dc97d623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:14.411812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b6d15-be30-4ad0-8568-edd6dc97d623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:14.413179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b6d15-be30-4ad0-8568-edd6dc97d623 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:14.425979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 328/670] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:14.426870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b6d15-be30-4ad0-8568-edd6dc97d623 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.463389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d7f5a-e56f-4310-a645-23f2d3fd316d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.499319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b141d-2ce8-40d3-b199-cfc6324b663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.499866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b141d-2ce8-40d3-b199-cfc6324b663b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.500141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b141d-2ce8-40d3-b199-cfc6324b663b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.500410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b141d-2ce8-40d3-b199-cfc6324b663b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.506993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b141d-2ce8-40d3-b199-cfc6324b663b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:14.508413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b141d-2ce8-40d3-b199-cfc6324b663b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1e5b141d-2ce8-40d3-b199-cfc6324b663b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:14.520149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:14.521053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:14.522363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:14.522363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:14.522363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:14.522363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:14.522363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:14.522363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:14.522363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:14.522363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:14.522363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 343/671] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:14.522363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b141d-2ce8-40d3-b199-cfc6324b663b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.533269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b6d15-be30-4ad0-8568-edd6dc97d623 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.562525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:14.569404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf9e47-a138-408e-8bdb-00b04c007672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.570221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf9e47-a138-408e-8bdb-00b04c007672 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.570496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf9e47-a138-408e-8bdb-00b04c007672 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.570766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf9e47-a138-408e-8bdb-00b04c007672 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.571450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf9e47-a138-408e-8bdb-00b04c007672 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:14.571756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf9e47-a138-408e-8bdb-00b04c007672 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:14.573190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf9e47-a138-408e-8bdb-00b04c007672 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:14.586084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 329/672] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:14.587423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf9e47-a138-408e-8bdb-00b04c007672 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.632784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b141d-2ce8-40d3-b199-cfc6324b663b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.641298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:14.675932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524fd2-da92-49f2-928f-1dec79b28174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.676833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524fd2-da92-49f2-928f-1dec79b28174 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.677313 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524fd2-da92-49f2-928f-1dec79b28174 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.677794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524fd2-da92-49f2-928f-1dec79b28174 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.689696 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524fd2-da92-49f2-928f-1dec79b28174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:14.695612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf9e47-a138-408e-8bdb-00b04c007672 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1a524fd2-da92-49f2-928f-1dec79b28174 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:14.695752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:14.696597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:14.697437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:14.705308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 344/673] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:14.705308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524fd2-da92-49f2-928f-1dec79b28174 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.734165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a4ed6-9157-4809-bd3e-1c9cecbd41b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.734807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a4ed6-9157-4809-bd3e-1c9cecbd41b8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.735084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a4ed6-9157-4809-bd3e-1c9cecbd41b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.735356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a4ed6-9157-4809-bd3e-1c9cecbd41b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.742163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a4ed6-9157-4809-bd3e-1c9cecbd41b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:14.743605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a4ed6-9157-4809-bd3e-1c9cecbd41b8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ea8a4ed6-9157-4809-bd3e-1c9cecbd41b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:14.755936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:14.756811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:14.758129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:14.758129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:14.758129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:14.758129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:14.758129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:14.758129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:14.758129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:14.758129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:14.758129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 330/674] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:14.763377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a4ed6-9157-4809-bd3e-1c9cecbd41b8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.812469 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524fd2-da92-49f2-928f-1dec79b28174 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.815676 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:14.848741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce9508-3eff-45b9-b71e-8a1f8f3686b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.849740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce9508-3eff-45b9-b71e-8a1f8f3686b5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.850288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce9508-3eff-45b9-b71e-8a1f8f3686b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.850566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce9508-3eff-45b9-b71e-8a1f8f3686b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.851246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce9508-3eff-45b9-b71e-8a1f8f3686b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:14.851551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce9508-3eff-45b9-b71e-8a1f8f3686b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:14.852961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce9508-3eff-45b9-b71e-8a1f8f3686b5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:14.866983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 345/675] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:14.867722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce9508-3eff-45b9-b71e-8a1f8f3686b5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.874288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a4ed6-9157-4809-bd3e-1c9cecbd41b8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.896571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:14.909667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef732cdb-a795-411d-8cf0-f09c7c311241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.910445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef732cdb-a795-411d-8cf0-f09c7c311241 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.910660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef732cdb-a795-411d-8cf0-f09c7c311241 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.910927 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef732cdb-a795-411d-8cf0-f09c7c311241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.911636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef732cdb-a795-411d-8cf0-f09c7c311241 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=c9cdd3fefd3f44eeaf19adbfac1ea13b) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:14.912242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef732cdb-a795-411d-8cf0-f09c7c311241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:14.913645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef732cdb-a795-411d-8cf0-f09c7c311241 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:14.923932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 331/676] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/role_assignments?user.id=c9cdd3fefd3f44eeaf19adbfac1ea13b&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:14.925252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef732cdb-a795-411d-8cf0-f09c7c311241 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:14.981398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce9508-3eff-45b9-b71e-8a1f8f3686b5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:15.022813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240e65b-bb99-4b9c-9211-45684939788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:15.023754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240e65b-bb99-4b9c-9211-45684939788e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.024178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240e65b-bb99-4b9c-9211-45684939788e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.024638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240e65b-bb99-4b9c-9211-45684939788e None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.025464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240e65b-bb99-4b9c-9211-45684939788e None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:15.026098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240e65b-bb99-4b9c-9211-45684939788e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:15.028947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240e65b-bb99-4b9c-9211-45684939788e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:15.038651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 346/677] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:15.040152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240e65b-bb99-4b9c-9211-45684939788e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:15.050021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef732cdb-a795-411d-8cf0-f09c7c311241 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:15.078052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:15.093167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f52a-fde9-4d95-bf8b-478667d69f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:15.093817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f52a-fde9-4d95-bf8b-478667d69f2c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.094101 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f52a-fde9-4d95-bf8b-478667d69f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.094377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f52a-fde9-4d95-bf8b-478667d69f2c None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.095081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6f52a-fde9-4d95-bf8b-478667d69f2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:15.095387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6f52a-fde9-4d95-bf8b-478667d69f2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:15.096983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6f52a-fde9-4d95-bf8b-478667d69f2c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:15.115156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 332/678] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:15.116318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f52a-fde9-4d95-bf8b-478667d69f2c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:15.157849 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:15.174576 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240e65b-bb99-4b9c-9211-45684939788e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:15.221940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ed8f-d505-4c41-bdf5-1fbe7f18cb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:15.222551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ed8f-d505-4c41-bdf5-1fbe7f18cb3f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.222825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ed8f-d505-4c41-bdf5-1fbe7f18cb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.223352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ed8f-d505-4c41-bdf5-1fbe7f18cb3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.224067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ed8f-d505-4c41-bdf5-1fbe7f18cb3f None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=4fe0dabaf0ef4fc7b417d378334413c6) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:15.224371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ed8f-d505-4c41-bdf5-1fbe7f18cb3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:15.225811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ed8f-d505-4c41-bdf5-1fbe7f18cb3f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:15.231849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f52a-fde9-4d95-bf8b-478667d69f2c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:15.232131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 347/679] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:15 2022] GET /identity/v3/role_assignments?user.id=4fe0dabaf0ef4fc7b417d378334413c6&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:15.232890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ed8f-d505-4c41-bdf5-1fbe7f18cb3f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:15.306392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10d21d-ed54-44fc-b397-cf533b6fadba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:15.307044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10d21d-ed54-44fc-b397-cf533b6fadba None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.307378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10d21d-ed54-44fc-b397-cf533b6fadba None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.308238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10d21d-ed54-44fc-b397-cf533b6fadba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.326307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10d21d-ed54-44fc-b397-cf533b6fadba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:15.327784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10d21d-ed54-44fc-b397-cf533b6fadba None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4f10d21d-ed54-44fc-b397-cf533b6fadba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:15.354171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:15.355235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:15.356115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:15.356115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:15.356115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:15.356115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 333/680] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:15.361007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10d21d-ed54-44fc-b397-cf533b6fadba None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:15.417022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:15.441875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ed8f-d505-4c41-bdf5-1fbe7f18cb3f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:15.506734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02a952-9a5f-4d00-98c8-e53519789355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:15.507787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02a952-9a5f-4d00-98c8-e53519789355 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.508141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02a952-9a5f-4d00-98c8-e53519789355 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.508668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02a952-9a5f-4d00-98c8-e53519789355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.509404 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02a952-9a5f-4d00-98c8-e53519789355 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=3f20fbf033f04036b48194a804dae8c3) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:15.509741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02a952-9a5f-4d00-98c8-e53519789355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:15.511808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02a952-9a5f-4d00-98c8-e53519789355 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:15.518910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 348/681] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:15 2022] GET /identity/v3/role_assignments?user.id=3f20fbf033f04036b48194a804dae8c3&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:15.546061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10d21d-ed54-44fc-b397-cf533b6fadba None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:15.585708 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ef0b3-9f32-464d-88f8-5f1516d6888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:15.586325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ef0b3-9f32-464d-88f8-5f1516d6888b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.586601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ef0b3-9f32-464d-88f8-5f1516d6888b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.586870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ef0b3-9f32-464d-88f8-5f1516d6888b None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.587543 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ef0b3-9f32-464d-88f8-5f1516d6888b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:15.587914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ef0b3-9f32-464d-88f8-5f1516d6888b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:15.589449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ef0b3-9f32-464d-88f8-5f1516d6888b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:15.604065 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 334/682] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:15.611554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02a952-9a5f-4d00-98c8-e53519789355 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:15.642605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:15.756473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c35952-42a9-43a3-81e7-afd8ffc96a44 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.757098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c35952-42a9-43a3-81e7-afd8ffc96a44 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.757591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c35952-42a9-43a3-81e7-afd8ffc96a44 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.759794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02a952-9a5f-4d00-98c8-e53519789355 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:15.760460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 335/683] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:15.765824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03843d6-6230-4480-854e-360e1b4b4883 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.766218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03843d6-6230-4480-854e-360e1b4b4883 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.766593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03843d6-6230-4480-854e-360e1b4b4883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.789274 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b03843d6-6230-4480-854e-360e1b4b4883 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:15.791649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b03843d6-6230-4480-854e-360e1b4b4883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:15.799177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1e4ea-f259-4609-85c6-0f8e2e375557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:15.800029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1e4ea-f259-4609-85c6-0f8e2e375557 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.800455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1e4ea-f259-4609-85c6-0f8e2e375557 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.800869 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1e4ea-f259-4609-85c6-0f8e2e375557 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.811025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1e4ea-f259-4609-85c6-0f8e2e375557 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:15.812897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1e4ea-f259-4609-85c6-0f8e2e375557 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b5d1e4ea-f259-4609-85c6-0f8e2e375557 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:15.826698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:15.827861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:15.828829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:15.828829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:15.828829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:15.828829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:15.828829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:15.828829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:15.828829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:15.828829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:15.828829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:15.828829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:15.831233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 349/684] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:15.837759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1e4ea-f259-4609-85c6-0f8e2e375557 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:15.891100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 336/685] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:59:15.946646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:15.968929 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1e4ea-f259-4609-85c6-0f8e2e375557 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:16.011934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c378e6-1c19-4894-aaa8-aa3d5bb8e683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:16.012930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c378e6-1c19-4894-aaa8-aa3d5bb8e683 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:16.013433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c378e6-1c19-4894-aaa8-aa3d5bb8e683 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:16.013934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c378e6-1c19-4894-aaa8-aa3d5bb8e683 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:16.014929 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c378e6-1c19-4894-aaa8-aa3d5bb8e683 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:16.015436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c378e6-1c19-4894-aaa8-aa3d5bb8e683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:16.017188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c378e6-1c19-4894-aaa8-aa3d5bb8e683 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:16.037811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 350/686] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 19 11:59:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:16.043864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03843d6-6230-4480-854e-360e1b4b4883 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:16.064874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:16.155852 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03843d6-6230-4480-854e-360e1b4b4883 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:16.181474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c378e6-1c19-4894-aaa8-aa3d5bb8e683 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:16.195906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c427b-571a-4c7d-8581-e827cdf75157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:16.195906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c427b-571a-4c7d-8581-e827cdf75157 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:16.195906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c427b-571a-4c7d-8581-e827cdf75157 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:16.195906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c427b-571a-4c7d-8581-e827cdf75157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:16.269655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c427b-571a-4c7d-8581-e827cdf75157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:16.269655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c427b-571a-4c7d-8581-e827cdf75157 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:16.286933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:16.344919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c378e6-1c19-4894-aaa8-aa3d5bb8e683 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:16.383175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 337/687] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:16.384788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c427b-571a-4c7d-8581-e827cdf75157 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:16.412335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ae8f6-d191-406d-ad09-f78c151dfa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:16.413280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae8f6-d191-406d-ad09-f78c151dfa32 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:16.415433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae8f6-d191-406d-ad09-f78c151dfa32 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:16.415893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae8f6-d191-406d-ad09-f78c151dfa32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:16.419952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:16.433448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ae8f6-d191-406d-ad09-f78c151dfa32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-140ae8f6-d191-406d-ad09-f78c151dfa32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:16.439295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:16.440211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:16.441042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:16.443400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 351/688] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:16.450052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ae8f6-d191-406d-ad09-f78c151dfa32 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:16.568767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c427b-571a-4c7d-8581-e827cdf75157 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:16.601974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:16.622679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ae8f6-d191-406d-ad09-f78c151dfa32 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:16.631540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac6bc6-a225-4ecc-add5-c8a8e6c4a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:16.632175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6bc6-a225-4ecc-add5-c8a8e6c4a67a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:16.632449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6bc6-a225-4ecc-add5-c8a8e6c4a67a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:16.632713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6bc6-a225-4ecc-add5-c8a8e6c4a67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:16.649243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac6bc6-a225-4ecc-add5-c8a8e6c4a67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:16.650714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac6bc6-a225-4ecc-add5-c8a8e6c4a67a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-05ac6bc6-a225-4ecc-add5-c8a8e6c4a67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:16.678339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:16.679258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:16.680134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:16.680134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:16.680134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:16.680134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 338/689] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:16.686003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac6bc6-a225-4ecc-add5-c8a8e6c4a67a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:16.687361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72aca8-c34b-41f2-be27-549629e9d711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:16.687966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72aca8-c34b-41f2-be27-549629e9d711 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:16.689788 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72aca8-c34b-41f2-be27-549629e9d711 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:16.690420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72aca8-c34b-41f2-be27-549629e9d711 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:16.691439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72aca8-c34b-41f2-be27-549629e9d711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:16.691756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72aca8-c34b-41f2-be27-549629e9d711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:16.693124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72aca8-c34b-41f2-be27-549629e9d711 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:16.707160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 352/690] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:16.714647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72aca8-c34b-41f2-be27-549629e9d711 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:16.834968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:16.842437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac6bc6-a225-4ecc-add5-c8a8e6c4a67a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:16.878944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56a26-7e4e-4b02-a65e-2a76e5cde3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:16.879946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56a26-7e4e-4b02-a65e-2a76e5cde3ba None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:16.880452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56a26-7e4e-4b02-a65e-2a76e5cde3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:16.880798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56a26-7e4e-4b02-a65e-2a76e5cde3ba None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:16.881499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56a26-7e4e-4b02-a65e-2a76e5cde3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:16.881912 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56a26-7e4e-4b02-a65e-2a76e5cde3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:16.883894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56a26-7e4e-4b02-a65e-2a76e5cde3ba None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:16.897734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 339/691] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:16.904514 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56a26-7e4e-4b02-a65e-2a76e5cde3ba None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:16.952316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72aca8-c34b-41f2-be27-549629e9d711 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:16.952936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:17.001820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71594360-07fc-4fe0-986d-2352e6f7ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:17.002908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594360-07fc-4fe0-986d-2352e6f7ce69 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:17.003396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594360-07fc-4fe0-986d-2352e6f7ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:17.003875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594360-07fc-4fe0-986d-2352e6f7ce69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:17.017993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71594360-07fc-4fe0-986d-2352e6f7ce69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:17.019942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71594360-07fc-4fe0-986d-2352e6f7ce69 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-71594360-07fc-4fe0-986d-2352e6f7ce69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:17.035986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:17.037015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:17.037927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:17.037927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:17.037927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:17.040290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 353/692] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:17.045865 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71594360-07fc-4fe0-986d-2352e6f7ce69 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:17.152492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56a26-7e4e-4b02-a65e-2a76e5cde3ba None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:17.158820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71594360-07fc-4fe0-986d-2352e6f7ce69 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:17.168489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:17.215992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad5bf8-24a6-4107-adf8-8fa5d212938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:17.216959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad5bf8-24a6-4107-adf8-8fa5d212938d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:17.217460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad5bf8-24a6-4107-adf8-8fa5d212938d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:17.217966 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad5bf8-24a6-4107-adf8-8fa5d212938d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:17.219684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d92530-a5f1-4f38-a0d0-0359ba6a65f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:17.220445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d92530-a5f1-4f38-a0d0-0359ba6a65f3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:17.220750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d92530-a5f1-4f38-a0d0-0359ba6a65f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:17.221021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d92530-a5f1-4f38-a0d0-0359ba6a65f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:17.221686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d92530-a5f1-4f38-a0d0-0359ba6a65f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:17.221991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d92530-a5f1-4f38-a0d0-0359ba6a65f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:17.223935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d92530-a5f1-4f38-a0d0-0359ba6a65f3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:17.235402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad5bf8-24a6-4107-adf8-8fa5d212938d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:17.237119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad5bf8-24a6-4107-adf8-8fa5d212938d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-79ad5bf8-24a6-4107-adf8-8fa5d212938d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:17.254678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:17.255599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:17.256505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:17.256505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:17.256505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:17.256505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:17.256505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:17.256505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:17.256505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:17.256505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:17.259330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 354/693] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:17.267088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d92530-a5f1-4f38-a0d0-0359ba6a65f3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:17.267754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 340/694] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:17.279026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad5bf8-24a6-4107-adf8-8fa5d212938d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:17.415342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d92530-a5f1-4f38-a0d0-0359ba6a65f3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:17.453607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5457999-4746-476e-9d1b-62f8210c47fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:17.455541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5457999-4746-476e-9d1b-62f8210c47fd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:17.456051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5457999-4746-476e-9d1b-62f8210c47fd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:17.456528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5457999-4746-476e-9d1b-62f8210c47fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:17.466467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5457999-4746-476e-9d1b-62f8210c47fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:17.468237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5457999-4746-476e-9d1b-62f8210c47fd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:17.474054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f5457999-4746-476e-9d1b-62f8210c47fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:17.486029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:17.486987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:17.487903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:17.487903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:17.487903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:17.487903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:17.487903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:17.487903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:17.487903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:17.487903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:17.487903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:59:17.487903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:17.488418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad5bf8-24a6-4107-adf8-8fa5d212938d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:17.491668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 355/695] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 19 11:59:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:17.493148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4d59-0132-4e33-9271-8e8ab8240fb9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:17.493661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4d59-0132-4e33-9271-8e8ab8240fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:17.494141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4d59-0132-4e33-9271-8e8ab8240fb9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:17.497302 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 356/696] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:17.499328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c4d59-0132-4e33-9271-8e8ab8240fb9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:17.530646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa10e0-f7b9-43f6-87a8-cd7bc98c4202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:17.531878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa10e0-f7b9-43f6-87a8-cd7bc98c4202 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:17.532608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa10e0-f7b9-43f6-87a8-cd7bc98c4202 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:17.533774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:17.534021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa10e0-f7b9-43f6-87a8-cd7bc98c4202 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:17.535902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa10e0-f7b9-43f6-87a8-cd7bc98c4202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:17.536660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa10e0-f7b9-43f6-87a8-cd7bc98c4202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:17.539939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa10e0-f7b9-43f6-87a8-cd7bc98c4202 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:17.558833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 341/697] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:17.560549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23486d-7d60-4fee-86c8-54f0b8629b88 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:17.561038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23486d-7d60-4fee-86c8-54f0b8629b88 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:17.561987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23486d-7d60-4fee-86c8-54f0b8629b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:17.587982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4a23486d-7d60-4fee-86c8-54f0b8629b88 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:17.590388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4a23486d-7d60-4fee-86c8-54f0b8629b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:17.624546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c4d59-0132-4e33-9271-8e8ab8240fb9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:17.664949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14b24c-f305-443f-9fb5-a7e6b2671c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:17.664949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b24c-f305-443f-9fb5-a7e6b2671c9c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:17.664949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b24c-f305-443f-9fb5-a7e6b2671c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:17.664949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b24c-f305-443f-9fb5-a7e6b2671c9c None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:17.665358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14b24c-f305-443f-9fb5-a7e6b2671c9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:17.665358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14b24c-f305-443f-9fb5-a7e6b2671c9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:17.666630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14b24c-f305-443f-9fb5-a7e6b2671c9c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:17.691846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 357/698] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 19 11:59:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:17.693561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14b24c-f305-443f-9fb5-a7e6b2671c9c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:17.693867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 342/699] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:17.696816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23486d-7d60-4fee-86c8-54f0b8629b88 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:17.797368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:17.815960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14b24c-f305-443f-9fb5-a7e6b2671c9c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:17.853060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:17.857184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaf87b-53fb-4b86-a0b7-b784b91c9aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:17.858113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaf87b-53fb-4b86-a0b7-b784b91c9aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:17.858603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaf87b-53fb-4b86-a0b7-b784b91c9aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:17.859080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaf87b-53fb-4b86-a0b7-b784b91c9aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:17.860003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeaf87b-53fb-4b86-a0b7-b784b91c9aa0 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=7b33b44f0e354c16846dd87179131141) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:17.860540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeaf87b-53fb-4b86-a0b7-b784b91c9aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:17.863960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeaf87b-53fb-4b86-a0b7-b784b91c9aa0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:17.871556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 358/700] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:17 2022] GET /identity/v3/role_assignments?user.id=7b33b44f0e354c16846dd87179131141&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:17.892097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23486d-7d60-4fee-86c8-54f0b8629b88 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:17.933923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e284a-8ed2-49f1-9ce2-a791ef487c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:17.934925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e284a-8ed2-49f1-9ce2-a791ef487c00 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:17.935409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e284a-8ed2-49f1-9ce2-a791ef487c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:17.935886 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e284a-8ed2-49f1-9ce2-a791ef487c00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.025502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e284a-8ed2-49f1-9ce2-a791ef487c00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:18.027835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e284a-8ed2-49f1-9ce2-a791ef487c00 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:18.037718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaf87b-53fb-4b86-a0b7-b784b91c9aa0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:18.130284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:18.161649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 343/701] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:18.163223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a28059-d126-46ad-b0ed-ca2131ecbf74 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.163916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a28059-d126-46ad-b0ed-ca2131ecbf74 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.164202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a28059-d126-46ad-b0ed-ca2131ecbf74 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.166013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 344/702] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:18.166711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a28059-d126-46ad-b0ed-ca2131ecbf74 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:18.225925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaf87b-53fb-4b86-a0b7-b784b91c9aa0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:18.269604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c9a20-8f3a-4e94-807f-1ec3dd0a5d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:18.270326 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9a20-8f3a-4e94-807f-1ec3dd0a5d38 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.270606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9a20-8f3a-4e94-807f-1ec3dd0a5d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.270880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9a20-8f3a-4e94-807f-1ec3dd0a5d38 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.271483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c9a20-8f3a-4e94-807f-1ec3dd0a5d38 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:18.272900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c9a20-8f3a-4e94-807f-1ec3dd0a5d38 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-bb9c9a20-8f3a-4e94-807f-1ec3dd0a5d38 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:18.285559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:18.286754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:18.288002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 359/703] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Sep 19 11:59:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:18.288802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f3b9-27b2-45f4-b429-2c3592c772fa None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.288802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f3b9-27b2-45f4-b429-2c3592c772fa None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.288924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f3b9-27b2-45f4-b429-2c3592c772fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.311005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a28059-d126-46ad-b0ed-ca2131ecbf74 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:18.317078 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b439f3b9-27b2-45f4-b429-2c3592c772fa None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:18.318296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b439f3b9-27b2-45f4-b429-2c3592c772fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:18.328132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:18.351424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475b9b8-6f21-46cb-a6a4-79a7a9cba97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:18.352152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475b9b8-6f21-46cb-a6a4-79a7a9cba97e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.352438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475b9b8-6f21-46cb-a6a4-79a7a9cba97e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.352799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475b9b8-6f21-46cb-a6a4-79a7a9cba97e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.364609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475b9b8-6f21-46cb-a6a4-79a7a9cba97e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:18.366349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475b9b8-6f21-46cb-a6a4-79a7a9cba97e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c475b9b8-6f21-46cb-a6a4-79a7a9cba97e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:18.383726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:18.386539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:18.388526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:18.388526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:18.388526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:18.388526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 345/704] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:18.388526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475b9b8-6f21-46cb-a6a4-79a7a9cba97e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:18.391677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 360/705] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:18.392991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62b370-43d3-431d-a85f-150113ada416 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.393945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62b370-43d3-431d-a85f-150113ada416 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.394354 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62b370-43d3-431d-a85f-150113ada416 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.396032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 361/706] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:18.396966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62b370-43d3-431d-a85f-150113ada416 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:18.423200 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:18.499184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475b9b8-6f21-46cb-a6a4-79a7a9cba97e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:18.534941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d76cb-714b-43b4-9fe7-766efb77980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:18.535441 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62b370-43d3-431d-a85f-150113ada416 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:18.535554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d76cb-714b-43b4-9fe7-766efb77980b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.535814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d76cb-714b-43b4-9fe7-766efb77980b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.536089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d76cb-714b-43b4-9fe7-766efb77980b None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.536711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d76cb-714b-43b4-9fe7-766efb77980b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:18.537056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d76cb-714b-43b4-9fe7-766efb77980b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:18.538468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d76cb-714b-43b4-9fe7-766efb77980b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:18.548152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 346/707] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 19 11:59:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:18.548152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82ca91-afb6-4723-8e8a-ddba34ea928a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.548152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82ca91-afb6-4723-8e8a-ddba34ea928a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.548152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82ca91-afb6-4723-8e8a-ddba34ea928a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.565348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0c82ca91-afb6-4723-8e8a-ddba34ea928a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:18.566602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0c82ca91-afb6-4723-8e8a-ddba34ea928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:18.591859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db2a71-1796-4a30-8f6c-b2a2eda3d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:18.592475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db2a71-1796-4a30-8f6c-b2a2eda3d772 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.592753 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db2a71-1796-4a30-8f6c-b2a2eda3d772 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.593021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db2a71-1796-4a30-8f6c-b2a2eda3d772 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.593689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db2a71-1796-4a30-8f6c-b2a2eda3d772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:18.593990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db2a71-1796-4a30-8f6c-b2a2eda3d772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:18.595345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db2a71-1796-4a30-8f6c-b2a2eda3d772 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:18.608787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 362/708] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:18.609738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db2a71-1796-4a30-8f6c-b2a2eda3d772 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:18.613461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:18.650785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 347/709] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:18.651888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82ca91-afb6-4723-8e8a-ddba34ea928a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:18.706006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:18.744043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db2a71-1796-4a30-8f6c-b2a2eda3d772 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:18.780742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949462d7-bd28-4249-a063-3cd73dde730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:18.781500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949462d7-bd28-4249-a063-3cd73dde730e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.781915 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949462d7-bd28-4249-a063-3cd73dde730e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.782294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949462d7-bd28-4249-a063-3cd73dde730e None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.783027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949462d7-bd28-4249-a063-3cd73dde730e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:18.783434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949462d7-bd28-4249-a063-3cd73dde730e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:18.784898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949462d7-bd28-4249-a063-3cd73dde730e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:18.791311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 363/710] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 19 11:59:18 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:18.792963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949462d7-bd28-4249-a063-3cd73dde730e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:18.801297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82ca91-afb6-4723-8e8a-ddba34ea928a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:18.864347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f22b-154d-4867-a6e0-909cbd402f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:18.865173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f22b-154d-4867-a6e0-909cbd402f7f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.865548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f22b-154d-4867-a6e0-909cbd402f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.865949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f22b-154d-4867-a6e0-909cbd402f7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.874176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3f22b-154d-4867-a6e0-909cbd402f7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:18.875804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3f22b-154d-4867-a6e0-909cbd402f7f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:18.879336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7ce3f22b-154d-4867-a6e0-909cbd402f7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:18.888850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:18.890031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:18.891136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:18.891136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:18.891136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:18.891136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:18.891136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:18.891136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:18.891136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:18.891136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:18.892837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 348/711] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:18.898676 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f22b-154d-4867-a6e0-909cbd402f7f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:18.926811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949462d7-bd28-4249-a063-3cd73dde730e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:18.971768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a45b66-64d9-481f-a22a-e0be8647c9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:18.972705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a45b66-64d9-481f-a22a-e0be8647c9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:18.973390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a45b66-64d9-481f-a22a-e0be8647c9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:18.973843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a45b66-64d9-481f-a22a-e0be8647c9e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:18.974827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a45b66-64d9-481f-a22a-e0be8647c9e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:18.977262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a45b66-64d9-481f-a22a-e0be8647c9e3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-82a45b66-64d9-481f-a22a-e0be8647c9e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:18.989428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:18.990694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:59:18.991687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:18.994589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 364/712] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:18 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:18.995737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a45b66-64d9-481f-a22a-e0be8647c9e3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:19.043505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:19.064801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f22b-154d-4867-a6e0-909cbd402f7f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:19.111647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860ef6a-c6b7-47b4-b428-6ecfaca79308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:19.112654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ef6a-c6b7-47b4-b428-6ecfaca79308 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:19.113030 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ef6a-c6b7-47b4-b428-6ecfaca79308 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:19.113398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ef6a-c6b7-47b4-b428-6ecfaca79308 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:19.114231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860ef6a-c6b7-47b4-b428-6ecfaca79308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:19.114633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860ef6a-c6b7-47b4-b428-6ecfaca79308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:19.116802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860ef6a-c6b7-47b4-b428-6ecfaca79308 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:19.127327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a45b66-64d9-481f-a22a-e0be8647c9e3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:19.132026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 349/713] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:19.132856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860ef6a-c6b7-47b4-b428-6ecfaca79308 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:19.167863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:19.175060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a58a43-529a-429c-bef0-21f6d1e0cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:19.176117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a58a43-529a-429c-bef0-21f6d1e0cd5a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:19.176597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a58a43-529a-429c-bef0-21f6d1e0cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:19.177150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a58a43-529a-429c-bef0-21f6d1e0cd5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:19.191103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a58a43-529a-429c-bef0-21f6d1e0cd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:19.193564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a58a43-529a-429c-bef0-21f6d1e0cd5a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-23a58a43-529a-429c-bef0-21f6d1e0cd5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:19.211947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:19.212904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:19.214979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:19.214979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:19.214979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:19.221157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 365/714] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:19.221157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a58a43-529a-429c-bef0-21f6d1e0cd5a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:19.264752 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860ef6a-c6b7-47b4-b428-6ecfaca79308 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:19.301252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70227aa-03b7-4806-a683-180153b98025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:19.303077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70227aa-03b7-4806-a683-180153b98025 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:19.303559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70227aa-03b7-4806-a683-180153b98025 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:19.304051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70227aa-03b7-4806-a683-180153b98025 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:19.304915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70227aa-03b7-4806-a683-180153b98025 None admin] RBAC: Adding query filter params (name=network) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:19.305411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70227aa-03b7-4806-a683-180153b98025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:19.307599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70227aa-03b7-4806-a683-180153b98025 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:19.314316 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 350/715] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:19.315397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70227aa-03b7-4806-a683-180153b98025 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:19.329972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:19.341562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a58a43-529a-429c-bef0-21f6d1e0cd5a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:19.381515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cce84-0a22-4d6f-9f47-465438e6b7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:19.382150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cce84-0a22-4d6f-9f47-465438e6b7cf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:19.382427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cce84-0a22-4d6f-9f47-465438e6b7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:19.382698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cce84-0a22-4d6f-9f47-465438e6b7cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:19.383798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cce84-0a22-4d6f-9f47-465438e6b7cf None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=02430b0097f94fa0a2015480a6ec68eb) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:19.384107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cce84-0a22-4d6f-9f47-465438e6b7cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:19.386342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cce84-0a22-4d6f-9f47-465438e6b7cf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:19.399039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 366/716] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:19 2022] GET /identity/v3/role_assignments?user.id=02430b0097f94fa0a2015480a6ec68eb&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:19.399039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cce84-0a22-4d6f-9f47-465438e6b7cf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:19.485879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:19.505897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70227aa-03b7-4806-a683-180153b98025 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:19.580921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cce84-0a22-4d6f-9f47-465438e6b7cf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:19.585197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd87fb-9bf6-46b4-a232-1d2ccb6b4d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:19.589217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd87fb-9bf6-46b4-a232-1d2ccb6b4d37 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:19.589217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd87fb-9bf6-46b4-a232-1d2ccb6b4d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:19.589217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd87fb-9bf6-46b4-a232-1d2ccb6b4d37 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:19.589217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd87fb-9bf6-46b4-a232-1d2ccb6b4d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:19.589217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd87fb-9bf6-46b4-a232-1d2ccb6b4d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:19.589217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd87fb-9bf6-46b4-a232-1d2ccb6b4d37 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:19.613274 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 351/717] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:19.620934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd87fb-9bf6-46b4-a232-1d2ccb6b4d37 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:19.649554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d48e4-2895-40ab-b6ad-982e948438ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:19.650222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d48e4-2895-40ab-b6ad-982e948438ee None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:19.650694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d48e4-2895-40ab-b6ad-982e948438ee None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:19.650972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d48e4-2895-40ab-b6ad-982e948438ee None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:19.652390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d48e4-2895-40ab-b6ad-982e948438ee None admin] RBAC: Adding query filter params (type=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:19.652699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d48e4-2895-40ab-b6ad-982e948438ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:19.654677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d48e4-2895-40ab-b6ad-982e948438ee None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:19.663007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 367/718] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:19.718967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:19.756962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd87fb-9bf6-46b4-a232-1d2ccb6b4d37 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:19.794635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987bba-c56f-439d-8f4c-d956c140fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:19.795641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987bba-c56f-439d-8f4c-d956c140fad1 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:19.796117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987bba-c56f-439d-8f4c-d956c140fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:19.796582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987bba-c56f-439d-8f4c-d956c140fad1 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:19.797485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987bba-c56f-439d-8f4c-d956c140fad1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:19.799194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987bba-c56f-439d-8f4c-d956c140fad1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:19.825813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 352/719] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 11:59:19 2022] POST /identity/v3/users => generated 254 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:59:20.467046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029fba-6c38-477b-9f8c-55b496ccee3c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:20.467565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029fba-6c38-477b-9f8c-55b496ccee3c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:20.467640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029fba-6c38-477b-9f8c-55b496ccee3c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:20.469180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 368/720] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:20.474990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004cad-8250-4b17-be5f-272e7e2a0d7f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:20.475527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004cad-8250-4b17-be5f-272e7e2a0d7f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:20.475996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004cad-8250-4b17-be5f-272e7e2a0d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:20.502591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a1004cad-8250-4b17-be5f-272e7e2a0d7f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:20.504091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a1004cad-8250-4b17-be5f-272e7e2a0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:20.596054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 353/721] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:20.995921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c029fba-6c38-477b-9f8c-55b496ccee3c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:21.103647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c029fba-6c38-477b-9f8c-55b496ccee3c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:21.117924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:21.140279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13c7a-7a83-4d96-b495-fc98997e6c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:21.141262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13c7a-7a83-4d96-b495-fc98997e6c55 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:21.141820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13c7a-7a83-4d96-b495-fc98997e6c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:21.142288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13c7a-7a83-4d96-b495-fc98997e6c55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:21.153281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13c7a-7a83-4d96-b495-fc98997e6c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f1e13c7a-7a83-4d96-b495-fc98997e6c55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:21.158890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:21.159833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:21.160666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:21.163212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 369/722] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:21.169189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004cad-8250-4b17-be5f-272e7e2a0d7f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:21.230857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:21.281573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004cad-8250-4b17-be5f-272e7e2a0d7f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:21.336453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f956f7-957e-42d5-a996-6c75a1dd6f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:21.337520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f956f7-957e-42d5-a996-6c75a1dd6f36 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:21.338074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f956f7-957e-42d5-a996-6c75a1dd6f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:21.338540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f956f7-957e-42d5-a996-6c75a1dd6f36 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:21.339488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f956f7-957e-42d5-a996-6c75a1dd6f36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:21.339985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f956f7-957e-42d5-a996-6c75a1dd6f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:21.341563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f956f7-957e-42d5-a996-6c75a1dd6f36 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:21.351582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 354/723] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:21.357563 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13c7a-7a83-4d96-b495-fc98997e6c55 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:21.416313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb729bb-3171-4d32-a531-30481d6e0f2c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:21.416638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb729bb-3171-4d32-a531-30481d6e0f2c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:21.416893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb729bb-3171-4d32-a531-30481d6e0f2c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:21.418961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 355/724] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:21.427009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6a586-39a3-4f2b-a57f-2a50ee0cd866 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:21.427496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6a586-39a3-4f2b-a57f-2a50ee0cd866 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:21.428038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6a586-39a3-4f2b-a57f-2a50ee0cd866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:21.447672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-47a6a586-39a3-4f2b-a57f-2a50ee0cd866 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:21.450386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-47a6a586-39a3-4f2b-a57f-2a50ee0cd866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:21.490578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13c7a-7a83-4d96-b495-fc98997e6c55 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:21.523030 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 356/725] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:21.539587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22b35a-c99d-44db-8274-82edbb1cf15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:21.540457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22b35a-c99d-44db-8274-82edbb1cf15c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:21.540879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22b35a-c99d-44db-8274-82edbb1cf15c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:21.541337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22b35a-c99d-44db-8274-82edbb1cf15c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:21.557192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22b35a-c99d-44db-8274-82edbb1cf15c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:21.559485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22b35a-c99d-44db-8274-82edbb1cf15c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3a22b35a-c99d-44db-8274-82edbb1cf15c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:21.580958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:21.582145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:21.583234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:21.583234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:21.583234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:21.584882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 370/726] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:21.590370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6a586-39a3-4f2b-a57f-2a50ee0cd866 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:21.641166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:21.731704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6a586-39a3-4f2b-a57f-2a50ee0cd866 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:21.765988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb178e-d865-4be5-84d8-4d15600f94de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:21.766596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb178e-d865-4be5-84d8-4d15600f94de None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:21.766869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb178e-d865-4be5-84d8-4d15600f94de None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:21.767137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb178e-d865-4be5-84d8-4d15600f94de None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:21.767775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb178e-d865-4be5-84d8-4d15600f94de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:21.768074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb178e-d865-4be5-84d8-4d15600f94de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:21.769428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb178e-d865-4be5-84d8-4d15600f94de None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:21.781152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 357/727] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:21.786529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22b35a-c99d-44db-8274-82edbb1cf15c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:21.833482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:21.920441 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22b35a-c99d-44db-8274-82edbb1cf15c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:21.929864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb178e-d865-4be5-84d8-4d15600f94de None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:21.967810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b0fc-41ff-4ebc-872a-47ffdcc76f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:21.968873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b0fc-41ff-4ebc-872a-47ffdcc76f10 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:21.969358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b0fc-41ff-4ebc-872a-47ffdcc76f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:21.969867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b0fc-41ff-4ebc-872a-47ffdcc76f10 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:21.985963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7b0fc-41ff-4ebc-872a-47ffdcc76f10 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:21.988719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7b0fc-41ff-4ebc-872a-47ffdcc76f10 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7ab7b0fc-41ff-4ebc-872a-47ffdcc76f10 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:22.012237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:22.013282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:22.014255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:22.014255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:22.014255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:22.014255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:22.014255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:22.014255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:22.014255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:22.014255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:22.014255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:22.014255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:22.021873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 371/728] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:22.023417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b0fc-41ff-4ebc-872a-47ffdcc76f10 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:22.123729 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb178e-d865-4be5-84d8-4d15600f94de None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:22.131589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:22.139990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:22.159392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b0fc-41ff-4ebc-872a-47ffdcc76f10 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:22.163679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf453a0-7d70-4bbc-baf4-1aa93d92a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:22.164511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf453a0-7d70-4bbc-baf4-1aa93d92a71a None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:22.164935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf453a0-7d70-4bbc-baf4-1aa93d92a71a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:22.165412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf453a0-7d70-4bbc-baf4-1aa93d92a71a None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:22.166245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf453a0-7d70-4bbc-baf4-1aa93d92a71a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:22.168613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf453a0-7d70-4bbc-baf4-1aa93d92a71a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:22.192364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 358/729] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:59:21 2022] POST /identity/v3/services => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:59:22.194799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c0830-3f55-4eb0-88bd-4441957b0191 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:22.195704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c0830-3f55-4eb0-88bd-4441957b0191 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:22.196139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c0830-3f55-4eb0-88bd-4441957b0191 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:22.203034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 359/730] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:22.204878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ff39f-34fc-4687-b81c-037a62d319db None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:22.205313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ff39f-34fc-4687-b81c-037a62d319db None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:22.206102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ff39f-34fc-4687-b81c-037a62d319db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:22.221199 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a4e4a-0055-4875-b299-2bf86c27ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:22.222090 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a4e4a-0055-4875-b299-2bf86c27ac8c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:22.222534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a4e4a-0055-4875-b299-2bf86c27ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:22.223489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a4e4a-0055-4875-b299-2bf86c27ac8c None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:22.224162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a4e4a-0055-4875-b299-2bf86c27ac8c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:22.224602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a4e4a-0055-4875-b299-2bf86c27ac8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:22.226367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a4e4a-0055-4875-b299-2bf86c27ac8c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:22.231178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f70ff39f-34fc-4687-b81c-037a62d319db None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:22.232575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f70ff39f-34fc-4687-b81c-037a62d319db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:22.249952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 372/731] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 19 11:59:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:22.256035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a4e4a-0055-4875-b299-2bf86c27ac8c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:22.372266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 360/732] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:22.434817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a4e4a-0055-4875-b299-2bf86c27ac8c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:22.470726 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849635ab-daf3-4432-8d9b-bb66880ba6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:22.471613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849635ab-daf3-4432-8d9b-bb66880ba6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:22.472042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849635ab-daf3-4432-8d9b-bb66880ba6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:22.472458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849635ab-daf3-4432-8d9b-bb66880ba6e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:22.483069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:22.487694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4cd8d-c804-48f9-acce-016257f002dc None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:22.488318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4cd8d-c804-48f9-acce-016257f002dc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:22.489975 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4cd8d-c804-48f9-acce-016257f002dc None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:22.490425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 361/733] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:22.496538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24cc50-9d83-4b18-8969-f99ac20d71ab None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:22.496938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24cc50-9d83-4b18-8969-f99ac20d71ab None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:22.497320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24cc50-9d83-4b18-8969-f99ac20d71ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:22.520269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4b24cc50-9d83-4b18-8969-f99ac20d71ab None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:22.520972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4b24cc50-9d83-4b18-8969-f99ac20d71ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:22.559169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849635ab-daf3-4432-8d9b-bb66880ba6e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:22.560753 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849635ab-daf3-4432-8d9b-bb66880ba6e8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:22.615182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 362/734] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:59:22.670574 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 373/735] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:22 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:22.676582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24cc50-9d83-4b18-8969-f99ac20d71ab None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:22.682645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849635ab-daf3-4432-8d9b-bb66880ba6e8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:22.713245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:22.751908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:22.803355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24cc50-9d83-4b18-8969-f99ac20d71ab None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:22.842952 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb9fc7-d796-4609-a0fe-fa43c000b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:22.843598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb9fc7-d796-4609-a0fe-fa43c000b00b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:22.843878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb9fc7-d796-4609-a0fe-fa43c000b00b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:22.844152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb9fc7-d796-4609-a0fe-fa43c000b00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:22.857047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb9fc7-d796-4609-a0fe-fa43c000b00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:22.858676 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb9fc7-d796-4609-a0fe-fa43c000b00b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-8acb9fc7-d796-4609-a0fe-fa43c000b00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:22.874865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:22.875837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:22.876738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:22.876738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:22.876738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:22.876738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 363/736] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:22.881658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb9fc7-d796-4609-a0fe-fa43c000b00b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:22.911427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849635ab-daf3-4432-8d9b-bb66880ba6e8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:22.949954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30a467-b515-43d4-8ff7-3814beffd91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:22.950592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a467-b515-43d4-8ff7-3814beffd91a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:22.950875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a467-b515-43d4-8ff7-3814beffd91a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:22.951148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a467-b515-43d4-8ff7-3814beffd91a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:22.962321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30a467-b515-43d4-8ff7-3814beffd91a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:22.966552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-fd30a467-b515-43d4-8ff7-3814beffd91a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:22.969554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:22.971072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:22.971985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:22.975763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 374/737] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:22.977116 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f1b1-9676-4d60-ba19-1a0602d121ce None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:22.977411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f1b1-9676-4d60-ba19-1a0602d121ce None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:22.977704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f1b1-9676-4d60-ba19-1a0602d121ce None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:22.979063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 375/738] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:22.984188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1f1b1-9676-4d60-ba19-1a0602d121ce None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:22.993037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb9fc7-d796-4609-a0fe-fa43c000b00b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:23.026124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8540d07-f828-4269-a835-f773169c9808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:23.027385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8540d07-f828-4269-a835-f773169c9808 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:23.027676 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8540d07-f828-4269-a835-f773169c9808 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:23.027944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8540d07-f828-4269-a835-f773169c9808 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:23.028580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8540d07-f828-4269-a835-f773169c9808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:23.028881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8540d07-f828-4269-a835-f773169c9808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:23.030344 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8540d07-f828-4269-a835-f773169c9808 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:23.042814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 364/739] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:23.043005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8540d07-f828-4269-a835-f773169c9808 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:23.095866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:23.102318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1f1b1-9676-4d60-ba19-1a0602d121ce None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:23.138941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8222a-1039-4055-84fd-f65eb93a0ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:23.139553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8222a-1039-4055-84fd-f65eb93a0ea6 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:23.139837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8222a-1039-4055-84fd-f65eb93a0ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:23.140114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8222a-1039-4055-84fd-f65eb93a0ea6 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:23.140760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8222a-1039-4055-84fd-f65eb93a0ea6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:23.142166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8222a-1039-4055-84fd-f65eb93a0ea6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:23.146445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8540d07-f828-4269-a835-f773169c9808 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:23.165643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 376/740] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:59:22 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:59:23.165643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29953814-be49-46d7-9928-15d80f6c896b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:23.165643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29953814-be49-46d7-9928-15d80f6c896b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:23.165643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29953814-be49-46d7-9928-15d80f6c896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:23.181123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-29953814-be49-46d7-9928-15d80f6c896b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:23.182513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-29953814-be49-46d7-9928-15d80f6c896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:23.203808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4da5b-2223-4788-b679-1b7ec0150971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:23.204834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4da5b-2223-4788-b679-1b7ec0150971 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:23.205120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4da5b-2223-4788-b679-1b7ec0150971 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:23.205418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4da5b-2223-4788-b679-1b7ec0150971 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:23.206100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4da5b-2223-4788-b679-1b7ec0150971 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:23.206407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4da5b-2223-4788-b679-1b7ec0150971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:23.207785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4da5b-2223-4788-b679-1b7ec0150971 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:23.210359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:23.223722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 365/741] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:23.224663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4da5b-2223-4788-b679-1b7ec0150971 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:23.279743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 377/742] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:23.280893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29953814-be49-46d7-9928-15d80f6c896b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:23.356249 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4da5b-2223-4788-b679-1b7ec0150971 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:23.399385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe156a2-ba57-424c-b189-512cd9aad63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:23.400395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe156a2-ba57-424c-b189-512cd9aad63d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:23.400395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe156a2-ba57-424c-b189-512cd9aad63d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:23.400590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe156a2-ba57-424c-b189-512cd9aad63d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:23.414229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe156a2-ba57-424c-b189-512cd9aad63d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:23.416642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe156a2-ba57-424c-b189-512cd9aad63d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:23.422013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-fbe156a2-ba57-424c-b189-512cd9aad63d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:23.434542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:23.435456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:23.436337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:23.436337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:23.436337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:23.436337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:23.436337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:23.436337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:23.436337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:23.436337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:23.436337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 366/743] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:23.441437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe156a2-ba57-424c-b189-512cd9aad63d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:23.442805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29953814-be49-46d7-9928-15d80f6c896b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:23.491603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708734-c0b9-41a4-8d53-6d3cfb77ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:23.493225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708734-c0b9-41a4-8d53-6d3cfb77ffff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:23.493740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708734-c0b9-41a4-8d53-6d3cfb77ffff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:23.494252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708734-c0b9-41a4-8d53-6d3cfb77ffff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:23.511922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708734-c0b9-41a4-8d53-6d3cfb77ffff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:23.514181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708734-c0b9-41a4-8d53-6d3cfb77ffff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:23.518020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-85708734-c0b9-41a4-8d53-6d3cfb77ffff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:23.535182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:23.536388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:23.537470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:23.537470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:23.537470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:23.538099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 378/744] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:23.546553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708734-c0b9-41a4-8d53-6d3cfb77ffff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:23.574452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe156a2-ba57-424c-b189-512cd9aad63d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:23.609998 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ebbde-76ce-4a17-ae81-7c558dd1d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:23.610549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ebbde-76ce-4a17-ae81-7c558dd1d5cc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:23.610971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ebbde-76ce-4a17-ae81-7c558dd1d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:23.611339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ebbde-76ce-4a17-ae81-7c558dd1d5cc None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:23.612179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ebbde-76ce-4a17-ae81-7c558dd1d5cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:23.612588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ebbde-76ce-4a17-ae81-7c558dd1d5cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:23.614146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ebbde-76ce-4a17-ae81-7c558dd1d5cc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:23.627304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 367/745] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:23.632774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ebbde-76ce-4a17-ae81-7c558dd1d5cc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:23.670308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708734-c0b9-41a4-8d53-6d3cfb77ffff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:23.712981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60e8fa-2323-4c44-8ac6-0730d0fa3874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:23.714235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60e8fa-2323-4c44-8ac6-0730d0fa3874 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:23.714602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60e8fa-2323-4c44-8ac6-0730d0fa3874 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:23.714875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60e8fa-2323-4c44-8ac6-0730d0fa3874 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:23.715523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60e8fa-2323-4c44-8ac6-0730d0fa3874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:23.715816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60e8fa-2323-4c44-8ac6-0730d0fa3874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:23.717190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60e8fa-2323-4c44-8ac6-0730d0fa3874 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:23.726364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:23.734986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 379/746] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:23.734986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60e8fa-2323-4c44-8ac6-0730d0fa3874 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:23.752684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ebbde-76ce-4a17-ae81-7c558dd1d5cc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:23.771978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:23.793142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4ab96-b0ab-468a-97fa-f7806cca7a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:23.793787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4ab96-b0ab-468a-97fa-f7806cca7a23 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:23.794069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4ab96-b0ab-468a-97fa-f7806cca7a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:23.794340 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4ab96-b0ab-468a-97fa-f7806cca7a23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:23.795307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4ab96-b0ab-468a-97fa-f7806cca7a23 None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=7b33b44f0e354c16846dd87179131141) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:23.795618 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4ab96-b0ab-468a-97fa-f7806cca7a23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:23.797419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4ab96-b0ab-468a-97fa-f7806cca7a23 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:23.809655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 368/747] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:23 2022] GET /identity/v3/role_assignments?user.id=7b33b44f0e354c16846dd87179131141&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:23.809655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4ab96-b0ab-468a-97fa-f7806cca7a23 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:23.924690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60e8fa-2323-4c44-8ac6-0730d0fa3874 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:23.961346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4ab96-b0ab-468a-97fa-f7806cca7a23 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:24.001909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4856e-dd8b-4036-b71c-729dc629734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:24.002547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4856e-dd8b-4036-b71c-729dc629734b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:24.002879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4856e-dd8b-4036-b71c-729dc629734b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:24.003092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4856e-dd8b-4036-b71c-729dc629734b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:24.011790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4310d-218b-45c9-8448-492d5db7ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:24.011959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4856e-dd8b-4036-b71c-729dc629734b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:24.012590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4310d-218b-45c9-8448-492d5db7ff68 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:24.012936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4310d-218b-45c9-8448-492d5db7ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:24.013281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4310d-218b-45c9-8448-492d5db7ff68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:24.013433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4856e-dd8b-4036-b71c-729dc629734b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f1b4856e-dd8b-4036-b71c-729dc629734b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:24.025484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:24.026683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:24.027609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:24.027609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:24.027609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:24.027609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:24.027609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:24.027609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:24.027609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:24.027609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:24.027609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:59:24.027609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:24.028137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4310d-218b-45c9-8448-492d5db7ff68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:24.028209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 369/748] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 19 11:59:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c3e4310d-218b-45c9-8448-492d5db7ff68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:24.035523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:24.036430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:24.037273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 380/749] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:24.042412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4856e-dd8b-4036-b71c-729dc629734b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:24.047771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4310d-218b-45c9-8448-492d5db7ff68 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:24.127862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:24.144392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:24.187643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4310d-218b-45c9-8448-492d5db7ff68 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:24.231330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4df8-a043-49ff-ac61-7c9beffd699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:24.231997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4df8-a043-49ff-ac61-7c9beffd699e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:24.232371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4df8-a043-49ff-ac61-7c9beffd699e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:24.232645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4df8-a043-49ff-ac61-7c9beffd699e None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:24.233405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4df8-a043-49ff-ac61-7c9beffd699e None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:24.233731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4df8-a043-49ff-ac61-7c9beffd699e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:24.235194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4df8-a043-49ff-ac61-7c9beffd699e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:24.238730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4856e-dd8b-4036-b71c-729dc629734b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:24.250247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 381/750] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:24.260470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4df8-a043-49ff-ac61-7c9beffd699e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:24.301528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce39a-1c3f-4627-a434-f95cf82907a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:24.302213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce39a-1c3f-4627-a434-f95cf82907a2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:24.302485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce39a-1c3f-4627-a434-f95cf82907a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:24.302749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce39a-1c3f-4627-a434-f95cf82907a2 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:24.303469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ce39a-1c3f-4627-a434-f95cf82907a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:24.303768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ce39a-1c3f-4627-a434-f95cf82907a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:24.305725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ce39a-1c3f-4627-a434-f95cf82907a2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:24.344567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 370/751] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 19 11:59:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:24.350944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce39a-1c3f-4627-a434-f95cf82907a2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:24.430975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4df8-a043-49ff-ac61-7c9beffd699e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:24.457070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:24.466812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fb3a7-f646-4f71-aa84-8033ba6baf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:24.467566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb3a7-f646-4f71-aa84-8033ba6baf14 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:24.467914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb3a7-f646-4f71-aa84-8033ba6baf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:24.468281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb3a7-f646-4f71-aa84-8033ba6baf14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:24.480763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fb3a7-f646-4f71-aa84-8033ba6baf14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:24.482299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fb3a7-f646-4f71-aa84-8033ba6baf14 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e17fb3a7-f646-4f71-aa84-8033ba6baf14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:24.497530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:24.499720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:24.501871 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:24.501871 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:24.501871 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:24.501871 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 382/752] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:24.504937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fb3a7-f646-4f71-aa84-8033ba6baf14 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:24.514072 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:24.520705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce39a-1c3f-4627-a434-f95cf82907a2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:24.560803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004faa4-0474-455e-90bf-9e049bcac2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:24.561448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004faa4-0474-455e-90bf-9e049bcac2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:24.561771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004faa4-0474-455e-90bf-9e049bcac2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:24.562052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004faa4-0474-455e-90bf-9e049bcac2e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:24.588287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004faa4-0474-455e-90bf-9e049bcac2e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:24.590982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004faa4-0474-455e-90bf-9e049bcac2e3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:24.612592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fb3a7-f646-4f71-aa84-8033ba6baf14 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-2004faa4-0474-455e-90bf-9e049bcac2e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:24.626216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:24.628376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:24.630528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:24.630528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:24.630528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:24.630528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 371/753] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:24.634756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004faa4-0474-455e-90bf-9e049bcac2e3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:24.648243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d7b0b-3721-40c2-a905-3513c9a663e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:24.648845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d7b0b-3721-40c2-a905-3513c9a663e9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:24.649157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d7b0b-3721-40c2-a905-3513c9a663e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:24.649438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d7b0b-3721-40c2-a905-3513c9a663e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:24.650098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d7b0b-3721-40c2-a905-3513c9a663e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:24.650398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d7b0b-3721-40c2-a905-3513c9a663e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:24.651953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d7b0b-3721-40c2-a905-3513c9a663e9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:24.677912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 383/754] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:24.679329 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d7b0b-3721-40c2-a905-3513c9a663e9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:24.715141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:24.803473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d7b0b-3721-40c2-a905-3513c9a663e9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:24.844689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ee8d-785a-4852-93f4-e6001ae2c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:24.845333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ee8d-785a-4852-93f4-e6001ae2c62d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:24.845610 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ee8d-785a-4852-93f4-e6001ae2c62d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:24.846797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ee8d-785a-4852-93f4-e6001ae2c62d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:24.859149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1ee8d-785a-4852-93f4-e6001ae2c62d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:24.860680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1ee8d-785a-4852-93f4-e6001ae2c62d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:24.866996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004faa4-0474-455e-90bf-9e049bcac2e3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-99b1ee8d-785a-4852-93f4-e6001ae2c62d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:24.893384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:24.895668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:24.897931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 384/755] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 19 11:59:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:24.904533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ee8d-785a-4852-93f4-e6001ae2c62d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:24.933187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7756df-be79-44f8-8c00-cd6ee6eabf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:24.933827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7756df-be79-44f8-8c00-cd6ee6eabf1b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:24.934109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7756df-be79-44f8-8c00-cd6ee6eabf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:24.934383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7756df-be79-44f8-8c00-cd6ee6eabf1b None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:24.935027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7756df-be79-44f8-8c00-cd6ee6eabf1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:24.935330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7756df-be79-44f8-8c00-cd6ee6eabf1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:24.936691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7756df-be79-44f8-8c00-cd6ee6eabf1b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:24.959957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 372/756] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:24.966084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7756df-be79-44f8-8c00-cd6ee6eabf1b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:24.988036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:25.061921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:25.070291 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ee8d-785a-4852-93f4-e6001ae2c62d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:25.112031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eeb27-7a6b-48fe-b732-fb5bcfa26f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:25.112913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eeb27-7a6b-48fe-b732-fb5bcfa26f0d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:25.113343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eeb27-7a6b-48fe-b732-fb5bcfa26f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:25.113786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eeb27-7a6b-48fe-b732-fb5bcfa26f0d None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:25.114654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eeb27-7a6b-48fe-b732-fb5bcfa26f0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:25.114788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7756df-be79-44f8-8c00-cd6ee6eabf1b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:25.115233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eeb27-7a6b-48fe-b732-fb5bcfa26f0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:25.117964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eeb27-7a6b-48fe-b732-fb5bcfa26f0d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:25.139547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 385/757] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 19 11:59:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:25.141987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80ffee-1445-478b-be83-93847e004bf0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:25.142435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80ffee-1445-478b-be83-93847e004bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:25.142957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80ffee-1445-478b-be83-93847e004bf0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:25.144765 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 386/758] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:25.145643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80ffee-1445-478b-be83-93847e004bf0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:25.162580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca738f4-0435-4d86-a152-097ee02b75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:25.163271 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca738f4-0435-4d86-a152-097ee02b75f4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:25.163554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca738f4-0435-4d86-a152-097ee02b75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:25.164098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca738f4-0435-4d86-a152-097ee02b75f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:25.173976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca738f4-0435-4d86-a152-097ee02b75f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:25.175919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca738f4-0435-4d86-a152-097ee02b75f4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7ca738f4-0435-4d86-a152-097ee02b75f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:25.191519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:25.192619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:25.193545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:25.193545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:25.193545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:25.193545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:25.193545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:25.193545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:25.193545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:25.193545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:25.193545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 373/759] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:25.194336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a4eb-a851-4bb6-96ca-84ba8e02572c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:25.194609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a4eb-a851-4bb6-96ca-84ba8e02572c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:25.194937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a4eb-a851-4bb6-96ca-84ba8e02572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:25.221595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bce2a4eb-a851-4bb6-96ca-84ba8e02572c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:25.223883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bce2a4eb-a851-4bb6-96ca-84ba8e02572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:25.268211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80ffee-1445-478b-be83-93847e004bf0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:25.306893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a387e8-58e3-4e6e-93b3-49eb62023a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:25.307854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a387e8-58e3-4e6e-93b3-49eb62023a9a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:25.308570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a387e8-58e3-4e6e-93b3-49eb62023a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:25.309025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a387e8-58e3-4e6e-93b3-49eb62023a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:25.310588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:25.321774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 374/760] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:25.322820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a4eb-a851-4bb6-96ca-84ba8e02572c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:25.347598 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:25.407102 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a387e8-58e3-4e6e-93b3-49eb62023a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:25.408739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a387e8-58e3-4e6e-93b3-49eb62023a9a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:25.503504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a4eb-a851-4bb6-96ca-84ba8e02572c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:25.545305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 387/761] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:59:25.550840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a387e8-58e3-4e6e-93b3-49eb62023a9a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:25.565862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b25c5-665f-40b3-b3f0-b4ca6128998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:25.566754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b25c5-665f-40b3-b3f0-b4ca6128998e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:25.567397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b25c5-665f-40b3-b3f0-b4ca6128998e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:25.568883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b25c5-665f-40b3-b3f0-b4ca6128998e None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:25.569776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b25c5-665f-40b3-b3f0-b4ca6128998e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:25.570469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b25c5-665f-40b3-b3f0-b4ca6128998e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:25.572807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b25c5-665f-40b3-b3f0-b4ca6128998e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:25.591053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 375/762] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:25.598357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b25c5-665f-40b3-b3f0-b4ca6128998e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:25.658014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:25.719106 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:25.755745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a387e8-58e3-4e6e-93b3-49eb62023a9a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:25.773156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b25c5-665f-40b3-b3f0-b4ca6128998e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:25.794113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c75a99-ddfb-44db-b7ba-3f0a030831fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:25.794759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c75a99-ddfb-44db-b7ba-3f0a030831fc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:25.795039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c75a99-ddfb-44db-b7ba-3f0a030831fc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:25.795435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c75a99-ddfb-44db-b7ba-3f0a030831fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:25.807040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c75a99-ddfb-44db-b7ba-3f0a030831fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:25.808623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c75a99-ddfb-44db-b7ba-3f0a030831fc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:25.810462 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bd9f4-e53f-4c2c-8053-fbf991516397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:25.811128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bd9f4-e53f-4c2c-8053-fbf991516397 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:25.811406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bd9f4-e53f-4c2c-8053-fbf991516397 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:25.811678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bd9f4-e53f-4c2c-8053-fbf991516397 None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/02430b0097f94fa0a2015480a6ec68eb/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:25.813556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bd9f4-e53f-4c2c-8053-fbf991516397 None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=02430b0097f94fa0a2015480a6ec68eb, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:25.814982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bd9f4-e53f-4c2c-8053-fbf991516397 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e1c75a99-ddfb-44db-b7ba-3f0a030831fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:25.825852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:25.826797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:25.832624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:25.832624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:25.832624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:25.832624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 388/763] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:25.832624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c75a99-ddfb-44db-b7ba-3f0a030831fc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:25.832941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 376/764] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:59:25 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/02430b0097f94fa0a2015480a6ec68eb/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:59:25.832941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfe829-4ff5-4a87-bcff-2a86e8e0b5db None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:25.833074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfe829-4ff5-4a87-bcff-2a86e8e0b5db None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:25.833449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfe829-4ff5-4a87-bcff-2a86e8e0b5db None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:25.839826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 377/765] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:25.839826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfe829-4ff5-4a87-bcff-2a86e8e0b5db None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:25.968461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c75a99-ddfb-44db-b7ba-3f0a030831fc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:25.972271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:25.984018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfe829-4ff5-4a87-bcff-2a86e8e0b5db None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:26.007646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:26.022723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd9c33-cef4-411f-945a-fa505a748bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:26.023400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd9c33-cef4-411f-945a-fa505a748bef None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.023927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd9c33-cef4-411f-945a-fa505a748bef None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.024208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd9c33-cef4-411f-945a-fa505a748bef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.024890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd9c33-cef4-411f-945a-fa505a748bef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:26.024995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001266d5-dbee-4b61-ac1c-72cb2c666fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:26.025544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001266d5-dbee-4b61-ac1c-72cb2c666fef None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.025863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001266d5-dbee-4b61-ac1c-72cb2c666fef None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.026165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001266d5-dbee-4b61-ac1c-72cb2c666fef None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.026387 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd9c33-cef4-411f-945a-fa505a748bef None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:26.026801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001266d5-dbee-4b61-ac1c-72cb2c666fef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:26.027100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001266d5-dbee-4b61-ac1c-72cb2c666fef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:26.028451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001266d5-dbee-4b61-ac1c-72cb2c666fef None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c4cd9c33-cef4-411f-945a-fa505a748bef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:26.036846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:26.037856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:59:26.038722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:26.039531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 389/766] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Sep 19 11:59:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:26.040245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b5e06-cf2f-4111-83c0-cdbb63953ae8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.040532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b5e06-cf2f-4111-83c0-cdbb63953ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.040803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b5e06-cf2f-4111-83c0-cdbb63953ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.044522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 378/767] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:26.045414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001266d5-dbee-4b61-ac1c-72cb2c666fef None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:26.063446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f86b5e06-cf2f-4111-83c0-cdbb63953ae8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:26.064265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f86b5e06-cf2f-4111-83c0-cdbb63953ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:26.144308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 390/768] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:26.145171 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b5e06-cf2f-4111-83c0-cdbb63953ae8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:26.153593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001266d5-dbee-4b61-ac1c-72cb2c666fef None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:26.224675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66b7b6-e3e5-4d49-abe6-062583371366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:26.225743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66b7b6-e3e5-4d49-abe6-062583371366 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.226226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66b7b6-e3e5-4d49-abe6-062583371366 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.226697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66b7b6-e3e5-4d49-abe6-062583371366 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.228299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66b7b6-e3e5-4d49-abe6-062583371366 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:26.230145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66b7b6-e3e5-4d49-abe6-062583371366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:26.233995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66b7b6-e3e5-4d49-abe6-062583371366 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:26.246816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 379/769] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 19 11:59:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:26.252448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66b7b6-e3e5-4d49-abe6-062583371366 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:26.337302 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:26.341672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b5e06-cf2f-4111-83c0-cdbb63953ae8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:26.345577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:26.396193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39bf8d-5091-41e5-bfa4-beee0d7716cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:26.397323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39bf8d-5091-41e5-bfa4-beee0d7716cf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.398270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39bf8d-5091-41e5-bfa4-beee0d7716cf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.398688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39bf8d-5091-41e5-bfa4-beee0d7716cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.407452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39bf8d-5091-41e5-bfa4-beee0d7716cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:26.410011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39bf8d-5091-41e5-bfa4-beee0d7716cf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:26.418808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66b7b6-e3e5-4d49-abe6-062583371366 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8d39bf8d-5091-41e5-bfa4-beee0d7716cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:26.425107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:26.426175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:26.427227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:26.427227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:26.427227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:26.427227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:26.427227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:26.427227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:26.427227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:26.427227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:26.431104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 391/770] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:26.433977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bfb21-d3f1-4697-8dc9-fbfea185a61c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.434413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bfb21-d3f1-4697-8dc9-fbfea185a61c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.434853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bfb21-d3f1-4697-8dc9-fbfea185a61c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.441319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 392/771] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:26.442736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bfb21-d3f1-4697-8dc9-fbfea185a61c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:26.466886 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfec08-f9e4-4ef2-9afe-a395e5092d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:26.467732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfec08-f9e4-4ef2-9afe-a395e5092d1e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.468281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfec08-f9e4-4ef2-9afe-a395e5092d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.468551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfec08-f9e4-4ef2-9afe-a395e5092d1e None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.469168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfec08-f9e4-4ef2-9afe-a395e5092d1e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:26.469467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfec08-f9e4-4ef2-9afe-a395e5092d1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:26.470956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfec08-f9e4-4ef2-9afe-a395e5092d1e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:26.481776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 380/772] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 19 11:59:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:26.484033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcb1d-0872-406b-baf4-30f1f632361a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.484309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcb1d-0872-406b-baf4-30f1f632361a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.484578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcb1d-0872-406b-baf4-30f1f632361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.502627 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d7fdcb1d-0872-406b-baf4-30f1f632361a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:26.503803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d7fdcb1d-0872-406b-baf4-30f1f632361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:26.556432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bfb21-d3f1-4697-8dc9-fbfea185a61c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:26.574290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 381/773] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:26.575429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdcb1d-0872-406b-baf4-30f1f632361a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:26.592421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada47d7b-9277-48e8-a274-b27ac786bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:26.593087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47d7b-9277-48e8-a274-b27ac786bfbf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.593366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47d7b-9277-48e8-a274-b27ac786bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.593647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47d7b-9277-48e8-a274-b27ac786bfbf None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.594559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47d7b-9277-48e8-a274-b27ac786bfbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:26.594867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47d7b-9277-48e8-a274-b27ac786bfbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:26.596454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47d7b-9277-48e8-a274-b27ac786bfbf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:26.610760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 393/774] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:26.611488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada47d7b-9277-48e8-a274-b27ac786bfbf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:26.629711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:26.633827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:26.723596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdcb1d-0872-406b-baf4-30f1f632361a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:26.731861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada47d7b-9277-48e8-a274-b27ac786bfbf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:26.768412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091496ad-08da-429a-8c5b-8c7b958b4f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:26.769069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091496ad-08da-429a-8c5b-8c7b958b4f88 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.769356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091496ad-08da-429a-8c5b-8c7b958b4f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.769637 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091496ad-08da-429a-8c5b-8c7b958b4f88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.770353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091496ad-08da-429a-8c5b-8c7b958b4f88 None admin] RBAC: Adding query filter params (interface=public, service_id=eb3b2dbbd22d4bd78fdaf345f709f344, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:26.770661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091496ad-08da-429a-8c5b-8c7b958b4f88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:26.772013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091496ad-08da-429a-8c5b-8c7b958b4f88 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:26.772615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821e623-b21f-4a5d-b8c5-b4e43710ef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:26.773418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821e623-b21f-4a5d-b8c5-b4e43710ef3c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.773983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821e623-b21f-4a5d-b8c5-b4e43710ef3c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.774399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821e623-b21f-4a5d-b8c5-b4e43710ef3c None admin] PATH_INFO: `/v3/services/network` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.775114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821e623-b21f-4a5d-b8c5-b4e43710ef3c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:26.777600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821e623-b21f-4a5d-b8c5-b4e43710ef3c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:26.780433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 394/775] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 19 11:59:26 2022] GET /identity/v3/endpoints?service_id=eb3b2dbbd22d4bd78fdaf345f709f344&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:26.781068 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091496ad-08da-429a-8c5b-8c7b958b4f88 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1821e623-b21f-4a5d-b8c5-b4e43710ef3c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:26.790695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:26.791736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:59:26.792582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:26.796693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 382/776] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:26 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:26.797576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821e623-b21f-4a5d-b8c5-b4e43710ef3c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:26.893037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:26.903918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821e623-b21f-4a5d-b8c5-b4e43710ef3c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:26.905538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:26.915155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091496ad-08da-429a-8c5b-8c7b958b4f88 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:26.939066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb0094-89ce-4072-8fe0-8ed5621a24fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:26.939602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb0094-89ce-4072-8fe0-8ed5621a24fd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.939875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb0094-89ce-4072-8fe0-8ed5621a24fd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.940145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb0094-89ce-4072-8fe0-8ed5621a24fd None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.940738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb0094-89ce-4072-8fe0-8ed5621a24fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:26.942129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb0094-89ce-4072-8fe0-8ed5621a24fd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:26.947306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 383/777] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 19 11:59:26 2022] GET /identity/v3/services => generated 772 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:26.950232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b782d6-771b-4f4e-a1b9-f87f8d1686f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:26.950754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb0094-89ce-4072-8fe0-8ed5621a24fd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:26.950982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b782d6-771b-4f4e-a1b9-f87f8d1686f1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:26.951340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b782d6-771b-4f4e-a1b9-f87f8d1686f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:26.951680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b782d6-771b-4f4e-a1b9-f87f8d1686f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:26.952601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b782d6-771b-4f4e-a1b9-f87f8d1686f1 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=42d7224dbe7944789327082192495039) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:26.952975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b782d6-771b-4f4e-a1b9-f87f8d1686f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:26.954804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b782d6-771b-4f4e-a1b9-f87f8d1686f1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:26.965858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 395/778] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:26 2022] GET /identity/v3/role_assignments?user.id=42d7224dbe7944789327082192495039&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:26.967188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b782d6-771b-4f4e-a1b9-f87f8d1686f1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:27.178582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb0094-89ce-4072-8fe0-8ed5621a24fd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:27.179958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b782d6-771b-4f4e-a1b9-f87f8d1686f1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:27.218413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbad2c-7902-4618-b9f8-bcd1d2833332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:27.218967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbad2c-7902-4618-b9f8-bcd1d2833332 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:27.219241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbad2c-7902-4618-b9f8-bcd1d2833332 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:27.219517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbad2c-7902-4618-b9f8-bcd1d2833332 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:27.225886 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e777e-6d21-420e-9319-85fcabd56d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:27.227017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e777e-6d21-420e-9319-85fcabd56d45 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:27.227839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e777e-6d21-420e-9319-85fcabd56d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:27.228302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e777e-6d21-420e-9319-85fcabd56d45 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:27.229160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e777e-6d21-420e-9319-85fcabd56d45 None admin] RBAC: Adding query filter params (name=network) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:27.229899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e777e-6d21-420e-9319-85fcabd56d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:27.230948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbad2c-7902-4618-b9f8-bcd1d2833332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:27.231801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e777e-6d21-420e-9319-85fcabd56d45 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-dbdbad2c-7902-4618-b9f8-bcd1d2833332 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:27.236320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:27.237263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:27.238101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:27.240004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 384/780] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:27.240121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 396/780] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:27.244297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbad2c-7902-4618-b9f8-bcd1d2833332 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:27.246102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e777e-6d21-420e-9319-85fcabd56d45 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:27.254734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:27.286144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:27.403944 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbad2c-7902-4618-b9f8-bcd1d2833332 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:27.442899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e777e-6d21-420e-9319-85fcabd56d45 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:27.444706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd37b7b-f232-47c5-9599-6ce4ce61bd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:27.445610 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd37b7b-f232-47c5-9599-6ce4ce61bd23 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:27.446120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd37b7b-f232-47c5-9599-6ce4ce61bd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:27.446655 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd37b7b-f232-47c5-9599-6ce4ce61bd23 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:27.447551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd37b7b-f232-47c5-9599-6ce4ce61bd23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:27.448674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd37b7b-f232-47c5-9599-6ce4ce61bd23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:27.451710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd37b7b-f232-47c5-9599-6ce4ce61bd23 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:27.464866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 397/781] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:27.469773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd37b7b-f232-47c5-9599-6ce4ce61bd23 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:27.534333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8883ac6-8308-47d9-ac0c-62d996f26f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:27.534960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8883ac6-8308-47d9-ac0c-62d996f26f0e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:27.535238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8883ac6-8308-47d9-ac0c-62d996f26f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:27.535511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8883ac6-8308-47d9-ac0c-62d996f26f0e None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:27.536173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8883ac6-8308-47d9-ac0c-62d996f26f0e None admin] RBAC: Adding query filter params (type=network) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:27.536446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8883ac6-8308-47d9-ac0c-62d996f26f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:27.537842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8883ac6-8308-47d9-ac0c-62d996f26f0e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:27.547988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 385/782] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:27.551194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:27.553313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8883ac6-8308-47d9-ac0c-62d996f26f0e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:27.620604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd37b7b-f232-47c5-9599-6ce4ce61bd23 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:27.685363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec44ec2-e5f2-4543-b4bf-ea65b0da774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:27.686076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec44ec2-e5f2-4543-b4bf-ea65b0da774f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:27.686355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec44ec2-e5f2-4543-b4bf-ea65b0da774f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:27.686638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec44ec2-e5f2-4543-b4bf-ea65b0da774f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:27.693521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:27.702473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8883ac6-8308-47d9-ac0c-62d996f26f0e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:27.710847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec44ec2-e5f2-4543-b4bf-ea65b0da774f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:27.712066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec44ec2-e5f2-4543-b4bf-ea65b0da774f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9ec44ec2-e5f2-4543-b4bf-ea65b0da774f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:27.739522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:27.740483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:27.741361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:27.741361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:27.741361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:27.743192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e5461-b23b-4946-8982-bc4e1fce79cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:27.744071 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e5461-b23b-4946-8982-bc4e1fce79cf None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:27.744620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e5461-b23b-4946-8982-bc4e1fce79cf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:27.745331 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e5461-b23b-4946-8982-bc4e1fce79cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:27.745496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 398/783] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:27.746604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e5461-b23b-4946-8982-bc4e1fce79cf None admin] RBAC: Adding query filter params (interface=public, service_id=42000ba9a66e4e67a90c6cbc219efe8b, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:27.746715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec44ec2-e5f2-4543-b4bf-ea65b0da774f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:27.747397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e5461-b23b-4946-8982-bc4e1fce79cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:27.749010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e5461-b23b-4946-8982-bc4e1fce79cf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:27.758010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 386/784] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 19 11:59:27 2022] GET /identity/v3/endpoints?service_id=42000ba9a66e4e67a90c6cbc219efe8b&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:27.768476 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e5461-b23b-4946-8982-bc4e1fce79cf None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:27.888979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec44ec2-e5f2-4543-b4bf-ea65b0da774f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:27.929964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:27.958899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e5461-b23b-4946-8982-bc4e1fce79cf None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:27.959770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef8b7f-7b37-4d43-8f89-fa89be97ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:27.960429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef8b7f-7b37-4d43-8f89-fa89be97ff00 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:27.960711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef8b7f-7b37-4d43-8f89-fa89be97ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:27.960983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef8b7f-7b37-4d43-8f89-fa89be97ff00 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:27.961642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef8b7f-7b37-4d43-8f89-fa89be97ff00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:27.961944 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef8b7f-7b37-4d43-8f89-fa89be97ff00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:27.963368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef8b7f-7b37-4d43-8f89-fa89be97ff00 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:27.992836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 399/785] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:27.997969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef8b7f-7b37-4d43-8f89-fa89be97ff00 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:28.037795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3552-9696-44e4-a1aa-822652abe575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:28.038458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3552-9696-44e4-a1aa-822652abe575 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:28.038736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3552-9696-44e4-a1aa-822652abe575 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:28.039009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3552-9696-44e4-a1aa-822652abe575 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:28.039614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f3552-9696-44e4-a1aa-822652abe575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:28.040994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f3552-9696-44e4-a1aa-822652abe575 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:28.052276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 387/786] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 19 11:59:27 2022] GET /identity/v3/services => generated 772 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:28.154759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef8b7f-7b37-4d43-8f89-fa89be97ff00 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:28.215326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bd779-faab-451b-a6f0-dee3ea393542 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:28.215646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bd779-faab-451b-a6f0-dee3ea393542 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:28.215887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bd779-faab-451b-a6f0-dee3ea393542 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:28.215993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9d0c-acad-4130-bb43-f89f458a5978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:28.216558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9d0c-acad-4130-bb43-f89f458a5978 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:28.216843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9d0c-acad-4130-bb43-f89f458a5978 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:28.217113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9d0c-acad-4130-bb43-f89f458a5978 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:28.217473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 388/787] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:28.222883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6b6a-14f4-46c5-84b2-bcecc49719d4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:28.223422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6b6a-14f4-46c5-84b2-bcecc49719d4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:28.223693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6b6a-14f4-46c5-84b2-bcecc49719d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:28.232509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e9d0c-acad-4130-bb43-f89f458a5978 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:28.233991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e9d0c-acad-4130-bb43-f89f458a5978 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-732e9d0c-acad-4130-bb43-f89f458a5978 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:28.250300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:28.251266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:28.252187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 400/788] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:28.255139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-341f6b6a-14f4-46c5-84b2-bcecc49719d4 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:28.255884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-341f6b6a-14f4-46c5-84b2-bcecc49719d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:28.259053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9d0c-acad-4130-bb43-f89f458a5978 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:28.298013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:28.353999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:28.396375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 389/789] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:28.440641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9d0c-acad-4130-bb43-f89f458a5978 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:28.489264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe13aa-e3ef-439a-9434-3ddcf9d51fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:28.493945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe13aa-e3ef-439a-9434-3ddcf9d51fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:28.494238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe13aa-e3ef-439a-9434-3ddcf9d51fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:28.494520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe13aa-e3ef-439a-9434-3ddcf9d51fe8 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:28.495546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe13aa-e3ef-439a-9434-3ddcf9d51fe8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:28.495849 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe13aa-e3ef-439a-9434-3ddcf9d51fe8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:28.497334 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe13aa-e3ef-439a-9434-3ddcf9d51fe8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:28.516836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 401/790] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 19 11:59:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:28.522239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f6b6a-14f4-46c5-84b2-bcecc49719d4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:28.653261 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f6b6a-14f4-46c5-84b2-bcecc49719d4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:28.691995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f99d84-18f6-4f34-88cb-3d457b2f0543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:28.692632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f99d84-18f6-4f34-88cb-3d457b2f0543 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:28.692915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f99d84-18f6-4f34-88cb-3d457b2f0543 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:28.693190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f99d84-18f6-4f34-88cb-3d457b2f0543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:28.703648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f99d84-18f6-4f34-88cb-3d457b2f0543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:28.705160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f99d84-18f6-4f34-88cb-3d457b2f0543 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:28.718606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe13aa-e3ef-439a-9434-3ddcf9d51fe8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-36f99d84-18f6-4f34-88cb-3d457b2f0543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:28.722709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:28.723877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:28.724760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:28.724760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:28.724760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:28.724760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 390/791] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:28.729735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f99d84-18f6-4f34-88cb-3d457b2f0543 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:28.747519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:28.838652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f99d84-18f6-4f34-88cb-3d457b2f0543 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:28.882308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafbadf-762e-4158-b3d4-a069477ba540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:28.883361 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafbadf-762e-4158-b3d4-a069477ba540 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:28.883930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafbadf-762e-4158-b3d4-a069477ba540 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:28.884415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafbadf-762e-4158-b3d4-a069477ba540 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:28.885290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafbadf-762e-4158-b3d4-a069477ba540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:28.886374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafbadf-762e-4158-b3d4-a069477ba540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:28.888284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafbadf-762e-4158-b3d4-a069477ba540 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:28.893670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe13aa-e3ef-439a-9434-3ddcf9d51fe8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:28.898100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:28.920228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 391/792] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:28.925837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafbadf-762e-4158-b3d4-a069477ba540 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:28.931259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3cc62-dea7-4b75-9448-5bc83b9708df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:28.932749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3cc62-dea7-4b75-9448-5bc83b9708df None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:28.933582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3cc62-dea7-4b75-9448-5bc83b9708df None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:28.934095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3cc62-dea7-4b75-9448-5bc83b9708df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:28.945303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3cc62-dea7-4b75-9448-5bc83b9708df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-90a3cc62-dea7-4b75-9448-5bc83b9708df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:28.951016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:28.951933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:28.952803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:28.955267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 402/793] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:28.962529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3cc62-dea7-4b75-9448-5bc83b9708df None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:29.010007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:29.044027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafbadf-762e-4158-b3d4-a069477ba540 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:29.079510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6c26e-4195-486c-85c0-22a3d29cc305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:29.080158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6c26e-4195-486c-85c0-22a3d29cc305 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:29.080435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6c26e-4195-486c-85c0-22a3d29cc305 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:29.080705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6c26e-4195-486c-85c0-22a3d29cc305 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:29.087610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6c26e-4195-486c-85c0-22a3d29cc305 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:29.089260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6c26e-4195-486c-85c0-22a3d29cc305 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-94a6c26e-4195-486c-85c0-22a3d29cc305 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:29.101257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:29.102196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:29.103060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:29.103060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:29.103060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:29.103060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:29.103060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:29.103060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:29.103060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:29.103060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:29.103060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 392/794] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:29.110984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6c26e-4195-486c-85c0-22a3d29cc305 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:29.217499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6c26e-4195-486c-85c0-22a3d29cc305 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:29.242041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:29.251201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3cc62-dea7-4b75-9448-5bc83b9708df None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:29.252370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab77b-bac7-47d2-bae2-9e67cf7a23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:29.253068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab77b-bac7-47d2-bae2-9e67cf7a23a4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:29.253350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab77b-bac7-47d2-bae2-9e67cf7a23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:29.253633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab77b-bac7-47d2-bae2-9e67cf7a23a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:29.254328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ab77b-bac7-47d2-bae2-9e67cf7a23a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:29.254631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ab77b-bac7-47d2-bae2-9e67cf7a23a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:29.256057 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ab77b-bac7-47d2-bae2-9e67cf7a23a4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:29.270264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 393/795] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:29.278573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab77b-bac7-47d2-bae2-9e67cf7a23a4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:29.326508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673d8f2-88a8-4d88-b7d7-370f20fd4cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:29.327117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673d8f2-88a8-4d88-b7d7-370f20fd4cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:29.327394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673d8f2-88a8-4d88-b7d7-370f20fd4cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:29.327661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673d8f2-88a8-4d88-b7d7-370f20fd4cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:29.328319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673d8f2-88a8-4d88-b7d7-370f20fd4cd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:29.328616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673d8f2-88a8-4d88-b7d7-370f20fd4cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:29.332108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673d8f2-88a8-4d88-b7d7-370f20fd4cd8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:29.346057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 403/796] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:29.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673d8f2-88a8-4d88-b7d7-370f20fd4cd8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:29.393853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:29.419896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab77b-bac7-47d2-bae2-9e67cf7a23a4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:29.462173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e638-e62e-4065-930c-9e0e53298f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:29.462849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e638-e62e-4065-930c-9e0e53298f2d None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:29.463125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e638-e62e-4065-930c-9e0e53298f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:29.463975 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e638-e62e-4065-930c-9e0e53298f2d None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/7b33b44f0e354c16846dd87179131141/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:29.466178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396e638-e62e-4065-930c-9e0e53298f2d None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=7b33b44f0e354c16846dd87179131141, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:29.467664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396e638-e62e-4065-930c-9e0e53298f2d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:29.492897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 394/797] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:59:29 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/7b33b44f0e354c16846dd87179131141/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:59:29.546471 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673d8f2-88a8-4d88-b7d7-370f20fd4cd8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:29.615352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b94b-16ad-4596-8168-4d84e8880e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:29.616019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b94b-16ad-4596-8168-4d84e8880e57 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:29.616307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b94b-16ad-4596-8168-4d84e8880e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:29.616586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b94b-16ad-4596-8168-4d84e8880e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:29.624774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c269-a174-472d-877b-d652b6b398f9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:29.625600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c269-a174-472d-877b-d652b6b398f9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:29.625799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c269-a174-472d-877b-d652b6b398f9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:29.628641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 395/798] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:29.645214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142404f8-73e6-4369-8d7c-9a339038ca24 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:29.645214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142404f8-73e6-4369-8d7c-9a339038ca24 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:29.645214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142404f8-73e6-4369-8d7c-9a339038ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:29.646530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8b94b-16ad-4596-8168-4d84e8880e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:29.648028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8b94b-16ad-4596-8168-4d84e8880e57 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-67d8b94b-16ad-4596-8168-4d84e8880e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:29.679013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:29.680040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:29.681033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:29.681033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:29.681033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:29.681033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 404/799] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:29.688243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b94b-16ad-4596-8168-4d84e8880e57 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:29.692033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-142404f8-73e6-4369-8d7c-9a339038ca24 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:29.693792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-142404f8-73e6-4369-8d7c-9a339038ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:29.769913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:29.813143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 396/800] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:29.880645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51cb92-a4bd-44a4-ba0d-c73a6f5f086a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:29.880931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51cb92-a4bd-44a4-ba0d-c73a6f5f086a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:29.881118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51cb92-a4bd-44a4-ba0d-c73a6f5f086a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:29.882797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 397/801] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:29.893093 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3a663-0e0e-4eb3-81e6-f1fc354cbf63 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:29.893093 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3a663-0e0e-4eb3-81e6-f1fc354cbf63 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:29.893093 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3a663-0e0e-4eb3-81e6-f1fc354cbf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:29.925673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-38f3a663-0e0e-4eb3-81e6-f1fc354cbf63 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:29.926891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-38f3a663-0e0e-4eb3-81e6-f1fc354cbf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:29.945182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:29.998118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b94b-16ad-4596-8168-4d84e8880e57 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:30.060276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 398/802] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:30.066241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9670-a2f0-4266-bbae-00a931ca5d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:30.066874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9670-a2f0-4266-bbae-00a931ca5d40 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:30.067153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9670-a2f0-4266-bbae-00a931ca5d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:30.067423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9670-a2f0-4266-bbae-00a931ca5d40 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:30.068061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb9670-a2f0-4266-bbae-00a931ca5d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:30.068360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb9670-a2f0-4266-bbae-00a931ca5d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:30.069736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb9670-a2f0-4266-bbae-00a931ca5d40 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:30.086921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 405/803] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:30.094304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3a663-0e0e-4eb3-81e6-f1fc354cbf63 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:30.136859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9670-a2f0-4266-bbae-00a931ca5d40 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:30.230371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3a663-0e0e-4eb3-81e6-f1fc354cbf63 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:30.241833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:30.298420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9670-a2f0-4266-bbae-00a931ca5d40 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:30.317437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2eb0-4472-40f3-9421-48300a562812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:30.318607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2eb0-4472-40f3-9421-48300a562812 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:30.319748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2eb0-4472-40f3-9421-48300a562812 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:30.320398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2eb0-4472-40f3-9421-48300a562812 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:30.339309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca2eb0-4472-40f3-9421-48300a562812 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:30.342252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca2eb0-4472-40f3-9421-48300a562812 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:30.359432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5eca2eb0-4472-40f3-9421-48300a562812 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:30.366834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:30.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:30.369038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:30.369038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:30.369038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:30.369038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:30.369038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:30.369038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:30.369038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:30.369038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:30.369038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:59:30.369038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:30.371207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 399/804] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 19 11:59:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:30.379175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2eb0-4472-40f3-9421-48300a562812 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:30.388919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28181-920f-402b-8043-da4a921dcc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:30.391515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28181-920f-402b-8043-da4a921dcc5c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:30.392351 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28181-920f-402b-8043-da4a921dcc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:30.392831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28181-920f-402b-8043-da4a921dcc5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:30.420742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b28181-920f-402b-8043-da4a921dcc5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-73b28181-920f-402b-8043-da4a921dcc5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:30.426816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:30.427744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:30.428581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:30.431637 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 406/805] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:30.439121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28181-920f-402b-8043-da4a921dcc5c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:30.542603 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2eb0-4472-40f3-9421-48300a562812 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:30.563276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28181-920f-402b-8043-da4a921dcc5c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:30.579047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c517bf2-751a-4aad-8ab2-af761476449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:30.580013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517bf2-751a-4aad-8ab2-af761476449f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:30.580494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517bf2-751a-4aad-8ab2-af761476449f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:30.580979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517bf2-751a-4aad-8ab2-af761476449f None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:30.581942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c517bf2-751a-4aad-8ab2-af761476449f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:30.582442 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c517bf2-751a-4aad-8ab2-af761476449f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:30.584053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c517bf2-751a-4aad-8ab2-af761476449f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:30.602777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2629474-16db-4e04-b151-2a8f3ca2ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:30.603484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629474-16db-4e04-b151-2a8f3ca2ec60 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:30.603847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629474-16db-4e04-b151-2a8f3ca2ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:30.604234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629474-16db-4e04-b151-2a8f3ca2ec60 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:30.604965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2629474-16db-4e04-b151-2a8f3ca2ec60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:30.605388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2629474-16db-4e04-b151-2a8f3ca2ec60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:30.605834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 400/806] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 19 11:59:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:30.606842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c517bf2-751a-4aad-8ab2-af761476449f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:30.611007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2629474-16db-4e04-b151-2a8f3ca2ec60 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:30.621047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 407/807] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:30.626041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2629474-16db-4e04-b151-2a8f3ca2ec60 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:30.638412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:30.697243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:30.748524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c517bf2-751a-4aad-8ab2-af761476449f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:30.757361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2629474-16db-4e04-b151-2a8f3ca2ec60 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:30.798901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1873cb-2d5b-4156-a3a1-d939251efc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:30.799532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1873cb-2d5b-4156-a3a1-d939251efc5d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:30.799807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1873cb-2d5b-4156-a3a1-d939251efc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:30.800073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1873cb-2d5b-4156-a3a1-d939251efc5d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:30.800648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1873cb-2d5b-4156-a3a1-d939251efc5d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:30.802032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1873cb-2d5b-4156-a3a1-d939251efc5d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:30.806916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7b40c-41ff-42f4-affe-62b80ef3499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:30.807805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7b40c-41ff-42f4-affe-62b80ef3499d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:30.808492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7b40c-41ff-42f4-affe-62b80ef3499d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:30.808959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7b40c-41ff-42f4-affe-62b80ef3499d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5d1873cb-2d5b-4156-a3a1-d939251efc5d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:30.811827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:30.812788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:59:30.813609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:30.817804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 401/808] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Sep 19 11:59:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:30.818695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1873cb-2d5b-4156-a3a1-d939251efc5d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:30.894603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7b40c-41ff-42f4-affe-62b80ef3499d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:30.896030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7b40c-41ff-42f4-affe-62b80ef3499d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:30.908404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:30.925682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1873cb-2d5b-4156-a3a1-d939251efc5d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:30.954597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:30.959278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39add9fd-32ae-4bb1-b091-9bd6b7395382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:30.959950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39add9fd-32ae-4bb1-b091-9bd6b7395382 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:30.960275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39add9fd-32ae-4bb1-b091-9bd6b7395382 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:30.960551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39add9fd-32ae-4bb1-b091-9bd6b7395382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:30.972255 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39add9fd-32ae-4bb1-b091-9bd6b7395382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:30.973969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39add9fd-32ae-4bb1-b091-9bd6b7395382 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-39add9fd-32ae-4bb1-b091-9bd6b7395382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:30.988703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:30.989642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:30.990566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:30.990566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:30.990566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:30.992085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 402/809] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:30.993039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39add9fd-32ae-4bb1-b091-9bd6b7395382 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:31.013952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 408/810] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:59:31.015509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100f9f3-4c4c-4ed6-a789-392bff4d7f7a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:31.015856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100f9f3-4c4c-4ed6-a789-392bff4d7f7a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:31.016190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100f9f3-4c4c-4ed6-a789-392bff4d7f7a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:31.017808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 409/811] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:31.018196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100f9f3-4c4c-4ed6-a789-392bff4d7f7a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:31.101228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39add9fd-32ae-4bb1-b091-9bd6b7395382 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:31.126424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100f9f3-4c4c-4ed6-a789-392bff4d7f7a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:31.136946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a4e75-e197-4d63-98b3-73614e047780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:31.137549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a4e75-e197-4d63-98b3-73614e047780 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:31.138089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a4e75-e197-4d63-98b3-73614e047780 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:31.138205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a4e75-e197-4d63-98b3-73614e047780 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:31.138737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a4e75-e197-4d63-98b3-73614e047780 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:31.139042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a4e75-e197-4d63-98b3-73614e047780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:31.140394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a4e75-e197-4d63-98b3-73614e047780 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:31.144922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 403/812] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 19 11:59:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:31.145606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a4e75-e197-4d63-98b3-73614e047780 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:31.148234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:31.167146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a866b-63de-4614-b7cf-b9ffef9224e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:31.167752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a866b-63de-4614-b7cf-b9ffef9224e1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:31.168029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a866b-63de-4614-b7cf-b9ffef9224e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:31.168299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a866b-63de-4614-b7cf-b9ffef9224e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:31.168930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a866b-63de-4614-b7cf-b9ffef9224e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:31.169456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a866b-63de-4614-b7cf-b9ffef9224e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:31.170617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a866b-63de-4614-b7cf-b9ffef9224e1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:31.182541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 410/813] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:31.183637 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1fc25-39ae-4593-b64e-c8cc7776ff2a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:31.183917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1fc25-39ae-4593-b64e-c8cc7776ff2a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:31.184191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1fc25-39ae-4593-b64e-c8cc7776ff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:31.202125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a1c1fc25-39ae-4593-b64e-c8cc7776ff2a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:31.203301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a1c1fc25-39ae-4593-b64e-c8cc7776ff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:31.214014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:31.256103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a4e75-e197-4d63-98b3-73614e047780 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:31.277688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 411/814] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:31.277688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1fc25-39ae-4593-b64e-c8cc7776ff2a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:31.295849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b39f-1589-4eb8-a59c-7247a1028300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:31.296766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b39f-1589-4eb8-a59c-7247a1028300 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:31.297193 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b39f-1589-4eb8-a59c-7247a1028300 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:31.297649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b39f-1589-4eb8-a59c-7247a1028300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:31.308711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b39f-1589-4eb8-a59c-7247a1028300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:31.310426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b39f-1589-4eb8-a59c-7247a1028300 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-8596b39f-1589-4eb8-a59c-7247a1028300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:31.325652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:31.326777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:31.327861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:31.327861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:31.327861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:31.329561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 404/815] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:31.330579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b39f-1589-4eb8-a59c-7247a1028300 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:31.398123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1fc25-39ae-4593-b64e-c8cc7776ff2a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:31.414576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:31.434133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7570b-6946-47e2-988b-ecf69eb8dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:31.434662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7570b-6946-47e2-988b-ecf69eb8dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:31.434939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7570b-6946-47e2-988b-ecf69eb8dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:31.435204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7570b-6946-47e2-988b-ecf69eb8dcf7 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:31.435825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7570b-6946-47e2-988b-ecf69eb8dcf7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:31.436124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7570b-6946-47e2-988b-ecf69eb8dcf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:31.437478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7570b-6946-47e2-988b-ecf69eb8dcf7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:31.442665 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 412/816] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 19 11:59:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:31.443396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7570b-6946-47e2-988b-ecf69eb8dcf7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:31.455247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:31.478803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b39f-1589-4eb8-a59c-7247a1028300 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:31.525004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299037-07c4-45db-bc08-49848240bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:31.525977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299037-07c4-45db-bc08-49848240bda2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:31.526401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299037-07c4-45db-bc08-49848240bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:31.526840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299037-07c4-45db-bc08-49848240bda2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:31.554170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7570b-6946-47e2-988b-ecf69eb8dcf7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:31.599836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3455bc3-ec87-45cb-9612-bde09551a962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:31.600464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3455bc3-ec87-45cb-9612-bde09551a962 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:31.600740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3455bc3-ec87-45cb-9612-bde09551a962 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:31.601008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3455bc3-ec87-45cb-9612-bde09551a962 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:31.601690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3455bc3-ec87-45cb-9612-bde09551a962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:31.602049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3455bc3-ec87-45cb-9612-bde09551a962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:31.603453 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3455bc3-ec87-45cb-9612-bde09551a962 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:31.616486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 413/817] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:31.617661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3455bc3-ec87-45cb-9612-bde09551a962 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:31.658967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299037-07c4-45db-bc08-49848240bda2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:31.662966 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299037-07c4-45db-bc08-49848240bda2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f7299037-07c4-45db-bc08-49848240bda2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:31.674704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:31.675638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:31.676584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 405/818] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 19 11:59:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:31.677155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299037-07c4-45db-bc08-49848240bda2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:31.698068 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:31.740340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3455bc3-ec87-45cb-9612-bde09551a962 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:31.777550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933b981-f133-4364-ba19-74c69642f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:31.778186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933b981-f133-4364-ba19-74c69642f9e0 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:31.778466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933b981-f133-4364-ba19-74c69642f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:31.778737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933b981-f133-4364-ba19-74c69642f9e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:31.779393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933b981-f133-4364-ba19-74c69642f9e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:31.780733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933b981-f133-4364-ba19-74c69642f9e0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:31.790416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299037-07c4-45db-bc08-49848240bda2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:31.808149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:31.810153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 414/819] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 11:59:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:59:31.812420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933b981-f133-4364-ba19-74c69642f9e0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:31.854106 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e70f-38c6-44ae-9184-861ebce54de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:31.856041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e70f-38c6-44ae-9184-861ebce54de6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:31.856549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e70f-38c6-44ae-9184-861ebce54de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:31.857019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e70f-38c6-44ae-9184-861ebce54de6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:31.857859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071e70f-38c6-44ae-9184-861ebce54de6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:31.860938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071e70f-38c6-44ae-9184-861ebce54de6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e071e70f-38c6-44ae-9184-861ebce54de6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:31.875196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:31.876341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:59:31.877157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:31.879216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 406/820] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:31 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:31.880998 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e70f-38c6-44ae-9184-861ebce54de6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:31.960697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933b981-f133-4364-ba19-74c69642f9e0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:31.989367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:32.007333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256d5a7-115c-41ba-aed2-a255b147f667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:32.007973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256d5a7-115c-41ba-aed2-a255b147f667 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.008286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256d5a7-115c-41ba-aed2-a255b147f667 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.008528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256d5a7-115c-41ba-aed2-a255b147f667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.014016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e70f-38c6-44ae-9184-861ebce54de6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:32.016909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256d5a7-115c-41ba-aed2-a255b147f667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:32.018372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256d5a7-115c-41ba-aed2-a255b147f667 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0256d5a7-115c-41ba-aed2-a255b147f667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:32.031470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:32.032426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:32.033332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:32.033332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:32.033332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:32.033332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:32.033332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:32.033332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:32.033332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:32.033332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:32.033332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 415/821] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:32.034256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256d5a7-115c-41ba-aed2-a255b147f667 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:32.050953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e445dc4-ab3c-4964-85f7-29a4d53f57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:32.051700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445dc4-ab3c-4964-85f7-29a4d53f57d2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.051985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445dc4-ab3c-4964-85f7-29a4d53f57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.052259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445dc4-ab3c-4964-85f7-29a4d53f57d2 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.052972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e445dc4-ab3c-4964-85f7-29a4d53f57d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:32.053276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e445dc4-ab3c-4964-85f7-29a4d53f57d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:32.054728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e445dc4-ab3c-4964-85f7-29a4d53f57d2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:32.072070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 407/822] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 19 11:59:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:32.074139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b54a-4062-44a4-b8d7-a49d47780f59 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.074424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b54a-4062-44a4-b8d7-a49d47780f59 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.074696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b54a-4062-44a4-b8d7-a49d47780f59 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.076039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 408/823] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:32.076579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1b54a-4062-44a4-b8d7-a49d47780f59 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:32.113104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:32.153009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256d5a7-115c-41ba-aed2-a255b147f667 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:32.189139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685de2f-fe7f-46b9-b18e-f9cc9c7e14a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:32.189950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685de2f-fe7f-46b9-b18e-f9cc9c7e14a3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.190188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685de2f-fe7f-46b9-b18e-f9cc9c7e14a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.190466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685de2f-fe7f-46b9-b18e-f9cc9c7e14a3 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.191078 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685de2f-fe7f-46b9-b18e-f9cc9c7e14a3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:32.191241 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1b54a-4062-44a4-b8d7-a49d47780f59 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:32.191408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685de2f-fe7f-46b9-b18e-f9cc9c7e14a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:32.192732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685de2f-fe7f-46b9-b18e-f9cc9c7e14a3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:32.202086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 416/824] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:32.202086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685de2f-fe7f-46b9-b18e-f9cc9c7e14a3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:32.231686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5075f5-f9b1-4393-b2ea-8ddb679c726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:32.232212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5075f5-f9b1-4393-b2ea-8ddb679c726c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.232493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5075f5-f9b1-4393-b2ea-8ddb679c726c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.232765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5075f5-f9b1-4393-b2ea-8ddb679c726c None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.233448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5075f5-f9b1-4393-b2ea-8ddb679c726c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:32.233781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5075f5-f9b1-4393-b2ea-8ddb679c726c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:32.235212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5075f5-f9b1-4393-b2ea-8ddb679c726c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:32.249150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 409/825] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:32.250393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced213e-0fd5-4451-b17c-dc6b0f511e0d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.250679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced213e-0fd5-4451-b17c-dc6b0f511e0d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.250953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced213e-0fd5-4451-b17c-dc6b0f511e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.258893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:32.268951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fced213e-0fd5-4451-b17c-dc6b0f511e0d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:32.270169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fced213e-0fd5-4451-b17c-dc6b0f511e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:32.313974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685de2f-fe7f-46b9-b18e-f9cc9c7e14a3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:32.344744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 410/826] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:32.345926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced213e-0fd5-4451-b17c-dc6b0f511e0d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:32.350792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86407-1fe5-46fd-bbf7-b1f0687d6145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:32.351706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86407-1fe5-46fd-bbf7-b1f0687d6145 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.352205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86407-1fe5-46fd-bbf7-b1f0687d6145 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.352678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86407-1fe5-46fd-bbf7-b1f0687d6145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.365997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86407-1fe5-46fd-bbf7-b1f0687d6145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:32.367739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86407-1fe5-46fd-bbf7-b1f0687d6145 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:32.375185 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-14c86407-1fe5-46fd-bbf7-b1f0687d6145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:32.390841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:32.391796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:32.392690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:32.392690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:32.392690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:32.397215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 417/827] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:32.398086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86407-1fe5-46fd-bbf7-b1f0687d6145 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:32.464737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced213e-0fd5-4451-b17c-dc6b0f511e0d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:32.514320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:32.514828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f834fb-9841-42e2-894c-7bb3e720e117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:32.515441 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f834fb-9841-42e2-894c-7bb3e720e117 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.515823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f834fb-9841-42e2-894c-7bb3e720e117 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.515989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f834fb-9841-42e2-894c-7bb3e720e117 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.516592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f834fb-9841-42e2-894c-7bb3e720e117 None admin] RBAC: Adding query filter params (type=network) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:32.516893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f834fb-9841-42e2-894c-7bb3e720e117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:32.519201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f834fb-9841-42e2-894c-7bb3e720e117 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:32.522322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86407-1fe5-46fd-bbf7-b1f0687d6145 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:32.532842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 411/828] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:32.534054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f834fb-9841-42e2-894c-7bb3e720e117 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:32.561334 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93b094-def0-444f-9031-eb0018a81d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:32.562052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93b094-def0-444f-9031-eb0018a81d83 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.562419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93b094-def0-444f-9031-eb0018a81d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.562810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93b094-def0-444f-9031-eb0018a81d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.563703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93b094-def0-444f-9031-eb0018a81d83 None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=02430b0097f94fa0a2015480a6ec68eb) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:32.564083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93b094-def0-444f-9031-eb0018a81d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:32.565675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93b094-def0-444f-9031-eb0018a81d83 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:32.577658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 418/829] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:32 2022] GET /identity/v3/role_assignments?user.id=02430b0097f94fa0a2015480a6ec68eb&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:32.577658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93b094-def0-444f-9031-eb0018a81d83 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:32.659354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:32.682192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f834fb-9841-42e2-894c-7bb3e720e117 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:32.721056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e87e-b734-42e5-b10b-2cec3b237ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:32.721445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e87e-b734-42e5-b10b-2cec3b237ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.721764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e87e-b734-42e5-b10b-2cec3b237ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.722229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e87e-b734-42e5-b10b-2cec3b237ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.722886 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e87e-b734-42e5-b10b-2cec3b237ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:32.723438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e87e-b734-42e5-b10b-2cec3b237ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:32.724829 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e87e-b734-42e5-b10b-2cec3b237ff4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:32.733835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93b094-def0-444f-9031-eb0018a81d83 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:32.738813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 412/830] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:32.739853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e87e-b734-42e5-b10b-2cec3b237ff4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:32.789191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469002f-c1c8-4bec-861d-1406fc27f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:32.790076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469002f-c1c8-4bec-861d-1406fc27f942 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.790933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469002f-c1c8-4bec-861d-1406fc27f942 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.791534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469002f-c1c8-4bec-861d-1406fc27f942 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.792480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469002f-c1c8-4bec-861d-1406fc27f942 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:32.793989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469002f-c1c8-4bec-861d-1406fc27f942 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:32.819064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 419/831] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 11:59:32 2022] POST /identity/v3/endpoints => generated 337 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:59:32.819911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469002f-c1c8-4bec-861d-1406fc27f942 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:32.853996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:32.866450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e87e-b734-42e5-b10b-2cec3b237ff4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:32.928214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cd3aa-66a6-4e05-b408-d682eb1c98b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:32.928858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cd3aa-66a6-4e05-b408-d682eb1c98b1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:32.929135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cd3aa-66a6-4e05-b408-d682eb1c98b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:32.929402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cd3aa-66a6-4e05-b408-d682eb1c98b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:32.945596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cd3aa-66a6-4e05-b408-d682eb1c98b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-666cd3aa-66a6-4e05-b408-d682eb1c98b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:32.953407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:32.954422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:32.955671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 413/832] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:32.961040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cd3aa-66a6-4e05-b408-d682eb1c98b1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:32.964423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:32.968478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469002f-c1c8-4bec-861d-1406fc27f942 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:33.007405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4fef1-818d-4794-b8b9-ba29dea69352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:33.008245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4fef1-818d-4794-b8b9-ba29dea69352 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:33.008625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4fef1-818d-4794-b8b9-ba29dea69352 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:33.008993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4fef1-818d-4794-b8b9-ba29dea69352 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:33.017325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4fef1-818d-4794-b8b9-ba29dea69352 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:33.018998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4fef1-818d-4794-b8b9-ba29dea69352 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8be4fef1-818d-4794-b8b9-ba29dea69352 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:33.031340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:33.032377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:33.033250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:33.033250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:33.033250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:33.033250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:33.033250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:33.033250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:33.033250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:33.033250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:33.033722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 420/833] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:33.039411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4fef1-818d-4794-b8b9-ba29dea69352 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:33.090548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cd3aa-66a6-4e05-b408-d682eb1c98b1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:33.139990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4506600-cb22-4786-bb2b-079b75f5affb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:33.141419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4506600-cb22-4786-bb2b-079b75f5affb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:33.141951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4506600-cb22-4786-bb2b-079b75f5affb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:33.142838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4506600-cb22-4786-bb2b-079b75f5affb None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:33.144000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4506600-cb22-4786-bb2b-079b75f5affb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:33.144513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4506600-cb22-4786-bb2b-079b75f5affb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:33.145250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:33.147764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4506600-cb22-4786-bb2b-079b75f5affb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:33.160869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 414/834] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:33.167443 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4506600-cb22-4786-bb2b-079b75f5affb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:33.172217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4fef1-818d-4794-b8b9-ba29dea69352 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:33.210550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732672e-d559-4d40-97de-a5b926389a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:33.211167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732672e-d559-4d40-97de-a5b926389a25 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:33.211507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732672e-d559-4d40-97de-a5b926389a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:33.211851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732672e-d559-4d40-97de-a5b926389a25 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:33.212599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732672e-d559-4d40-97de-a5b926389a25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:33.212988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732672e-d559-4d40-97de-a5b926389a25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:33.215617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732672e-d559-4d40-97de-a5b926389a25 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:33.231618 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 421/835] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:33.238359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732672e-d559-4d40-97de-a5b926389a25 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:33.254732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:33.313518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4506600-cb22-4786-bb2b-079b75f5affb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:33.371839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab0e5c-18f4-423b-a5c5-9e06f230c0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:33.372572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab0e5c-18f4-423b-a5c5-9e06f230c0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:33.372921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab0e5c-18f4-423b-a5c5-9e06f230c0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:33.373190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab0e5c-18f4-423b-a5c5-9e06f230c0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:33.376783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732672e-d559-4d40-97de-a5b926389a25 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:33.384828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab0e5c-18f4-423b-a5c5-9e06f230c0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:33.386852 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab0e5c-18f4-423b-a5c5-9e06f230c0c0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ebab0e5c-18f4-423b-a5c5-9e06f230c0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:33.402365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:33.403301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:33.404175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:33.404175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:33.404175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:33.408231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 415/836] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:33.409139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab0e5c-18f4-423b-a5c5-9e06f230c0c0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:33.415289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421a184-ae3c-4201-a957-7b67b1840ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:33.416169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a184-ae3c-4201-a957-7b67b1840ed5 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:33.417495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a184-ae3c-4201-a957-7b67b1840ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:33.418004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a184-ae3c-4201-a957-7b67b1840ed5 None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/42d7224dbe7944789327082192495039/roles/c926095789574c45a0a5fd3f2a25262f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:33.429418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:33.433760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421a184-ae3c-4201-a957-7b67b1840ed5 None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=42d7224dbe7944789327082192495039, role_id=c926095789574c45a0a5fd3f2a25262f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:33.435382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421a184-ae3c-4201-a957-7b67b1840ed5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:33.451190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 422/837] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:59:33 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/42d7224dbe7944789327082192495039/roles/c926095789574c45a0a5fd3f2a25262f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:59:33.538190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab0e5c-18f4-423b-a5c5-9e06f230c0c0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:33.557658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:33.579645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dff06-37b9-4f89-82d1-7d1339cf3f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:33.580175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dff06-37b9-4f89-82d1-7d1339cf3f64 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:33.580448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dff06-37b9-4f89-82d1-7d1339cf3f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:33.580773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dff06-37b9-4f89-82d1-7d1339cf3f64 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:33.581418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dff06-37b9-4f89-82d1-7d1339cf3f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:33.581813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dff06-37b9-4f89-82d1-7d1339cf3f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:33.583189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dff06-37b9-4f89-82d1-7d1339cf3f64 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:33.597770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 416/838] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:33.603836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421a184-ae3c-4201-a957-7b67b1840ed5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:33.722567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421a184-ae3c-4201-a957-7b67b1840ed5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:33.769516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a43d28-d90c-4608-a977-ad139cc1ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:33.770186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a43d28-d90c-4608-a977-ad139cc1ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:33.770460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a43d28-d90c-4608-a977-ad139cc1ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:33.770732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a43d28-d90c-4608-a977-ad139cc1ecd6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:33.778592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a43d28-d90c-4608-a977-ad139cc1ecd6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:33.780030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a43d28-d90c-4608-a977-ad139cc1ecd6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-78a43d28-d90c-4608-a977-ad139cc1ecd6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:33.792651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:33.793678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:33.794611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 423/839] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 11:59:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:33.801159 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dff06-37b9-4f89-82d1-7d1339cf3f64 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:33.943188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dff06-37b9-4f89-82d1-7d1339cf3f64 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:33.980911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5b69a-ee0a-4c4b-bbc6-cfb6d24b82ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:33.981834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5b69a-ee0a-4c4b-bbc6-cfb6d24b82ad None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:33.982287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5b69a-ee0a-4c4b-bbc6-cfb6d24b82ad None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:33.982832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5b69a-ee0a-4c4b-bbc6-cfb6d24b82ad None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:33.983726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5b69a-ee0a-4c4b-bbc6-cfb6d24b82ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:33.984202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5b69a-ee0a-4c4b-bbc6-cfb6d24b82ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:33.985817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5b69a-ee0a-4c4b-bbc6-cfb6d24b82ad None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:34.008164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 417/840] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 19 11:59:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:34.013736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a43d28-d90c-4608-a977-ad139cc1ecd6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:34.070035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:34.122010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a43d28-d90c-4608-a977-ad139cc1ecd6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:34.156858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188da03-4e7d-4f2c-8112-a013a07f25e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:34.157474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188da03-4e7d-4f2c-8112-a013a07f25e3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:34.157777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188da03-4e7d-4f2c-8112-a013a07f25e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:34.158045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188da03-4e7d-4f2c-8112-a013a07f25e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:34.158959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637cae5-b69a-4855-99a7-a6f6a7838b78 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:34.159342 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637cae5-b69a-4855-99a7-a6f6a7838b78 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:34.159716 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637cae5-b69a-4855-99a7-a6f6a7838b78 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:34.161381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 418/841] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:34.167424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a7f9f-977b-4849-a28e-63e6f0c298b0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:34.167816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a7f9f-977b-4849-a28e-63e6f0c298b0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:34.168197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a7f9f-977b-4849-a28e-63e6f0c298b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:34.186300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7f6a7f9f-977b-4849-a28e-63e6f0c298b0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:34.187571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7f6a7f9f-977b-4849-a28e-63e6f0c298b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:34.215867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:34.241910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188da03-4e7d-4f2c-8112-a013a07f25e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:34.243419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188da03-4e7d-4f2c-8112-a013a07f25e3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:34.285949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 419/842] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:34.299164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:34.355701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 424/843] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:34 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:59:34.361376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a7f9f-977b-4849-a28e-63e6f0c298b0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:34.466879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a7f9f-977b-4849-a28e-63e6f0c298b0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:34.504860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c929df-5a6a-462d-a31f-beb92bdcae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:34.505820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c929df-5a6a-462d-a31f-beb92bdcae59 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:34.506296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c929df-5a6a-462d-a31f-beb92bdcae59 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:34.506750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c929df-5a6a-462d-a31f-beb92bdcae59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:34.517179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c929df-5a6a-462d-a31f-beb92bdcae59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:34.518827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c929df-5a6a-462d-a31f-beb92bdcae59 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-21c929df-5a6a-462d-a31f-beb92bdcae59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:34.533209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:34.534182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:34.535081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:34.535081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:34.535081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:34.536878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 420/844] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:34.542977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188da03-4e7d-4f2c-8112-a013a07f25e3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:34.566384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c929df-5a6a-462d-a31f-beb92bdcae59 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:34.586934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:34.676411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188da03-4e7d-4f2c-8112-a013a07f25e3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:34.689178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c929df-5a6a-462d-a31f-beb92bdcae59 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:34.717843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fb8c7-c7e8-47f0-85d8-f46231a90478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:34.718376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fb8c7-c7e8-47f0-85d8-f46231a90478 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:34.718653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fb8c7-c7e8-47f0-85d8-f46231a90478 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:34.718926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fb8c7-c7e8-47f0-85d8-f46231a90478 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:34.719555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fb8c7-c7e8-47f0-85d8-f46231a90478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:34.719862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fb8c7-c7e8-47f0-85d8-f46231a90478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:34.721214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fb8c7-c7e8-47f0-85d8-f46231a90478 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:34.728609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe3d1-0fa6-43fd-9310-802c4258bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:34.729950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe3d1-0fa6-43fd-9310-802c4258bee9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:34.730445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe3d1-0fa6-43fd-9310-802c4258bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:34.730953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe3d1-0fa6-43fd-9310-802c4258bee9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:34.731822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fe3d1-0fa6-43fd-9310-802c4258bee9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:34.733409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fe3d1-0fa6-43fd-9310-802c4258bee9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:34.738795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 425/845] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:34.740049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fb8c7-c7e8-47f0-85d8-f46231a90478 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-956fe3d1-0fa6-43fd-9310-802c4258bee9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:34.744135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:34.746440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:59:34.747281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:34.750223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 421/846] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:59:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:34.753445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:34.755859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe3d1-0fa6-43fd-9310-802c4258bee9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:34.852737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:34.861782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fb8c7-c7e8-47f0-85d8-f46231a90478 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:34.875710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe3d1-0fa6-43fd-9310-802c4258bee9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:34.907184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909af29-8a74-474c-bda1-775997b2ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:34.908260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909af29-8a74-474c-bda1-775997b2ee02 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:34.908736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909af29-8a74-474c-bda1-775997b2ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:34.909219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909af29-8a74-474c-bda1-775997b2ee02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:34.911083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad49108-d75d-4860-b88a-072979ded94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:34.911731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49108-d75d-4860-b88a-072979ded94c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:34.911968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49108-d75d-4860-b88a-072979ded94c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:34.912242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49108-d75d-4860-b88a-072979ded94c None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:34.912869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad49108-d75d-4860-b88a-072979ded94c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:34.913170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad49108-d75d-4860-b88a-072979ded94c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:34.914570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad49108-d75d-4860-b88a-072979ded94c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:34.919347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909af29-8a74-474c-bda1-775997b2ee02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:34.920296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 422/847] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:59:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:34.921365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909af29-8a74-474c-bda1-775997b2ee02 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:34.928034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad49108-d75d-4860-b88a-072979ded94c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8909af29-8a74-474c-bda1-775997b2ee02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:34.940157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:34.941285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:34.942402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:34.942402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:34.942402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:34.942402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:34.942402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:34.942402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:34.942402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:34.942402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:34.945708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 426/848] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:34.948368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909af29-8a74-474c-bda1-775997b2ee02 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:35.039845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:35.043306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad49108-d75d-4860-b88a-072979ded94c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:35.080074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909af29-8a74-474c-bda1-775997b2ee02 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:35.084107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd8f2-c081-45e8-b9da-315c01ec6010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:35.084821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd8f2-c081-45e8-b9da-315c01ec6010 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:35.085210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd8f2-c081-45e8-b9da-315c01ec6010 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:35.085597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd8f2-c081-45e8-b9da-315c01ec6010 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:35.086349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd8f2-c081-45e8-b9da-315c01ec6010 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:35.086753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd8f2-c081-45e8-b9da-315c01ec6010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:35.088776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd8f2-c081-45e8-b9da-315c01ec6010 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:35.095968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 423/849] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:59:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:35.120016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0db84-cc24-4e61-909f-8c0b4563ce66 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:35.120296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0db84-cc24-4e61-909f-8c0b4563ce66 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:35.120573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0db84-cc24-4e61-909f-8c0b4563ce66 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:35.122283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 424/850] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:35.127971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197ccf8-851f-47e2-a914-ab52f667bb89 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:35.128334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197ccf8-851f-47e2-a914-ab52f667bb89 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:35.128606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197ccf8-851f-47e2-a914-ab52f667bb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:35.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590377e3-86f0-42ad-b5b5-d003239464c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:35.131116 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590377e3-86f0-42ad-b5b5-d003239464c0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:35.131496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590377e3-86f0-42ad-b5b5-d003239464c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:35.131870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590377e3-86f0-42ad-b5b5-d003239464c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:35.132679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590377e3-86f0-42ad-b5b5-d003239464c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:35.133088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590377e3-86f0-42ad-b5b5-d003239464c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:35.134699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590377e3-86f0-42ad-b5b5-d003239464c0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:35.149137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8197ccf8-851f-47e2-a914-ab52f667bb89 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:35.150523 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8197ccf8-851f-47e2-a914-ab52f667bb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:35.154103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 427/851] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:35.154253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:35.156474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590377e3-86f0-42ad-b5b5-d003239464c0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:35.238464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 425/852] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:35.287597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590377e3-86f0-42ad-b5b5-d003239464c0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:35.319132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:35.327451 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b390-2096-4c08-855f-2426bbfda3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:35.328061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b390-2096-4c08-855f-2426bbfda3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:35.328336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b390-2096-4c08-855f-2426bbfda3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:35.328604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b390-2096-4c08-855f-2426bbfda3b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:35.329320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873b390-2096-4c08-855f-2426bbfda3b3 None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=7b33b44f0e354c16846dd87179131141) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:35.329632 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873b390-2096-4c08-855f-2426bbfda3b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:35.331057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873b390-2096-4c08-855f-2426bbfda3b3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:35.341101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 428/853] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:35 2022] GET /identity/v3/role_assignments?user.id=7b33b44f0e354c16846dd87179131141&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:35.509084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197ccf8-851f-47e2-a914-ab52f667bb89 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:35.619479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197ccf8-851f-47e2-a914-ab52f667bb89 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:35.655257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a472-d507-4a3e-a712-6ad9a2a29535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:35.655892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a472-d507-4a3e-a712-6ad9a2a29535 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:35.656222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a472-d507-4a3e-a712-6ad9a2a29535 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:35.656497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a472-d507-4a3e-a712-6ad9a2a29535 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:35.657075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6a472-d507-4a3e-a712-6ad9a2a29535 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:35.658558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6a472-d507-4a3e-a712-6ad9a2a29535 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5da6a472-d507-4a3e-a712-6ad9a2a29535 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:35.670290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:35.671351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:35.672299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 426/854] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Sep 19 11:59:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:35.675943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b390-2096-4c08-855f-2426bbfda3b3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:35.785920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b390-2096-4c08-855f-2426bbfda3b3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:35.823618 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56f3e1-53ee-41bb-b96e-6bf76c6fcae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:35.824231 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56f3e1-53ee-41bb-b96e-6bf76c6fcae5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:35.824507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56f3e1-53ee-41bb-b96e-6bf76c6fcae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:35.824776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56f3e1-53ee-41bb-b96e-6bf76c6fcae5 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:35.825401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56f3e1-53ee-41bb-b96e-6bf76c6fcae5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:35.825728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56f3e1-53ee-41bb-b96e-6bf76c6fcae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:35.827076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56f3e1-53ee-41bb-b96e-6bf76c6fcae5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:35.832201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 429/855] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:35.839606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a472-d507-4a3e-a712-6ad9a2a29535 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:35.842700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:35.887993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73ea96-6816-461e-a051-315296040297 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:35.888340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73ea96-6816-461e-a051-315296040297 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:35.888712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73ea96-6816-461e-a051-315296040297 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:35.890468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 430/856] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:35.895929 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6a3e-babb-4504-b601-5c42b60102dc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:35.896318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6a3e-babb-4504-b601-5c42b60102dc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:35.896692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6a3e-babb-4504-b601-5c42b60102dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:35.916066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-425f6a3e-babb-4504-b601-5c42b60102dc None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:35.918802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-425f6a3e-babb-4504-b601-5c42b60102dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:35.952505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a472-d507-4a3e-a712-6ad9a2a29535 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:35.977411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:35.999493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 431/857] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:36.002682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a33cf-f4c4-4ae9-8da6-2efb7eb1fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:36.003540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a33cf-f4c4-4ae9-8da6-2efb7eb1fb39 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:36.004028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a33cf-f4c4-4ae9-8da6-2efb7eb1fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:36.004506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a33cf-f4c4-4ae9-8da6-2efb7eb1fb39 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:36.005359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a33cf-f4c4-4ae9-8da6-2efb7eb1fb39 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:36.005980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a33cf-f4c4-4ae9-8da6-2efb7eb1fb39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:36.007567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a33cf-f4c4-4ae9-8da6-2efb7eb1fb39 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:36.013593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 427/858] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:36.273812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f6a3e-babb-4504-b601-5c42b60102dc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:36.379233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f6a3e-babb-4504-b601-5c42b60102dc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:36.414094 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaff35-6fef-4c29-ad8e-2861f8471849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:36.414733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaff35-6fef-4c29-ad8e-2861f8471849 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:36.415015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaff35-6fef-4c29-ad8e-2861f8471849 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:36.415289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaff35-6fef-4c29-ad8e-2861f8471849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:36.425819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaff35-6fef-4c29-ad8e-2861f8471849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3ccaff35-6fef-4c29-ad8e-2861f8471849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:36.430609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:36.431512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:36.433057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 432/859] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 11:59:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:36.439987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a33cf-f4c4-4ae9-8da6-2efb7eb1fb39 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:36.507639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:36.544076 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a33cf-f4c4-4ae9-8da6-2efb7eb1fb39 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:36.577787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30488844-e813-4c7b-b710-ca0bd53169c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:36.578396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488844-e813-4c7b-b710-ca0bd53169c4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:36.578673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488844-e813-4c7b-b710-ca0bd53169c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:36.578943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488844-e813-4c7b-b710-ca0bd53169c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:36.579596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30488844-e813-4c7b-b710-ca0bd53169c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:36.579963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30488844-e813-4c7b-b710-ca0bd53169c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:36.581252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30488844-e813-4c7b-b710-ca0bd53169c4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:36.590364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 428/860] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 11:59:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:36.596028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaff35-6fef-4c29-ad8e-2861f8471849 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:36.659054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:36.714584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaff35-6fef-4c29-ad8e-2861f8471849 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:36.749167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70bf8-ed98-4d1e-8f06-618463501143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:36.749828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70bf8-ed98-4d1e-8f06-618463501143 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:36.750107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70bf8-ed98-4d1e-8f06-618463501143 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:36.750448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70bf8-ed98-4d1e-8f06-618463501143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:36.761771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70bf8-ed98-4d1e-8f06-618463501143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:36.763210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70bf8-ed98-4d1e-8f06-618463501143 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-38e70bf8-ed98-4d1e-8f06-618463501143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:36.778415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:36.779407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:36.780311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:36.780311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:36.780311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:36.780311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 433/861] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:36.786967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30488844-e813-4c7b-b710-ca0bd53169c4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:36.889419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30488844-e813-4c7b-b710-ca0bd53169c4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:36.915470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:36.923351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647ff64-379c-45e5-9e2a-dc99a5e45630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:36.924198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647ff64-379c-45e5-9e2a-dc99a5e45630 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:36.924644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647ff64-379c-45e5-9e2a-dc99a5e45630 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:36.925240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647ff64-379c-45e5-9e2a-dc99a5e45630 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:36.925943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647ff64-379c-45e5-9e2a-dc99a5e45630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:36.926246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647ff64-379c-45e5-9e2a-dc99a5e45630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:36.927597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647ff64-379c-45e5-9e2a-dc99a5e45630 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:36.944333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 429/862] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:36.945669 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70bf8-ed98-4d1e-8f06-618463501143 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:37.051117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:37.054113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70bf8-ed98-4d1e-8f06-618463501143 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:37.089083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcbf4e-55dd-4a90-8f14-3c8566d52b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:37.089733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcbf4e-55dd-4a90-8f14-3c8566d52b6b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:37.090018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcbf4e-55dd-4a90-8f14-3c8566d52b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:37.090291 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcbf4e-55dd-4a90-8f14-3c8566d52b6b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:37.097461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcbf4e-55dd-4a90-8f14-3c8566d52b6b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:37.099163 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcbf4e-55dd-4a90-8f14-3c8566d52b6b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-31dcbf4e-55dd-4a90-8f14-3c8566d52b6b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:37.111212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:37.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:37.113153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 434/863] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 19 11:59:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:37.118288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647ff64-379c-45e5-9e2a-dc99a5e45630 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:37.225342 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647ff64-379c-45e5-9e2a-dc99a5e45630 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:37.261234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25eb88-96e0-4318-9327-2e50f0f73b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:37.261869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25eb88-96e0-4318-9327-2e50f0f73b3c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:37.262147 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25eb88-96e0-4318-9327-2e50f0f73b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:37.262417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25eb88-96e0-4318-9327-2e50f0f73b3c None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:37.263197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25eb88-96e0-4318-9327-2e50f0f73b3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:37.263506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25eb88-96e0-4318-9327-2e50f0f73b3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:37.264955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25eb88-96e0-4318-9327-2e50f0f73b3c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:37.286166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 430/864] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 19 11:59:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:37.292381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcbf4e-55dd-4a90-8f14-3c8566d52b6b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:37.396414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d895f2-2125-49bb-8ed6-c734c2a94378 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:37.396779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d895f2-2125-49bb-8ed6-c734c2a94378 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:37.396955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d895f2-2125-49bb-8ed6-c734c2a94378 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:37.398573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 431/865] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:37.403489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcbf4e-55dd-4a90-8f14-3c8566d52b6b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:37.404038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b69e51-f997-4178-abac-577a1a32e442 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:37.404322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b69e51-f997-4178-abac-577a1a32e442 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:37.404600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b69e51-f997-4178-abac-577a1a32e442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:37.422872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e6b69e51-f997-4178-abac-577a1a32e442 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:37.424057 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e6b69e51-f997-4178-abac-577a1a32e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:37.439694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1b177-be7f-4818-b04f-a0a96497f1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:37.440574 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1b177-be7f-4818-b04f-a0a96497f1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:37.440996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1b177-be7f-4818-b04f-a0a96497f1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:37.441409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1b177-be7f-4818-b04f-a0a96497f1a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:37.476182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:37.479625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:37.517768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 432/866] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:37.527038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1b177-be7f-4818-b04f-a0a96497f1a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:37.528650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1b177-be7f-4818-b04f-a0a96497f1a9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:37.637712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 435/867] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:59:37.639389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b69e51-f997-4178-abac-577a1a32e442 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:37.664059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa32886-e907-40dc-a101-820e6aec8239 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:37.664571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa32886-e907-40dc-a101-820e6aec8239 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:37.665019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa32886-e907-40dc-a101-820e6aec8239 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:37.667141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 436/868] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:37.673455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86459d-47a7-435b-8d6f-a4cbfd27e93c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:37.673777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86459d-47a7-435b-8d6f-a4cbfd27e93c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:37.674051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86459d-47a7-435b-8d6f-a4cbfd27e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:37.697054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2b86459d-47a7-435b-8d6f-a4cbfd27e93c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:37.698982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2b86459d-47a7-435b-8d6f-a4cbfd27e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:37.753273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b69e51-f997-4178-abac-577a1a32e442 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:37.771835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:37.789649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 437/869] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:37.802701 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587db21-b581-43c7-88b9-2a259e94abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:37.803588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587db21-b581-43c7-88b9-2a259e94abfa None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:37.804063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587db21-b581-43c7-88b9-2a259e94abfa None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:37.804550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587db21-b581-43c7-88b9-2a259e94abfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:37.808653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86459d-47a7-435b-8d6f-a4cbfd27e93c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:37.818052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587db21-b581-43c7-88b9-2a259e94abfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:37.821918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587db21-b581-43c7-88b9-2a259e94abfa None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b587db21-b581-43c7-88b9-2a259e94abfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:37.841000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:37.842015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:37.842883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:37.842883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:37.842883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:37.846831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 433/870] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:37.847816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587db21-b581-43c7-88b9-2a259e94abfa None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:37.878210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:37.936671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86459d-47a7-435b-8d6f-a4cbfd27e93c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:37.961186 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587db21-b581-43c7-88b9-2a259e94abfa None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:37.980930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a6b9-f2b7-4211-a5d8-c6c64eec7222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:37.981925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a6b9-f2b7-4211-a5d8-c6c64eec7222 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:37.982403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a6b9-f2b7-4211-a5d8-c6c64eec7222 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:37.983298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a6b9-f2b7-4211-a5d8-c6c64eec7222 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:37.984309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2a6b9-f2b7-4211-a5d8-c6c64eec7222 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:37.986114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2a6b9-f2b7-4211-a5d8-c6c64eec7222 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:37.998742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7db23a-7313-4fed-a27e-40a69f9bc729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:37.999567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7db23a-7313-4fed-a27e-40a69f9bc729 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:37.999919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7db23a-7313-4fed-a27e-40a69f9bc729 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:38.000222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7db23a-7313-4fed-a27e-40a69f9bc729 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:38.000932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7db23a-7313-4fed-a27e-40a69f9bc729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:38.001364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7db23a-7313-4fed-a27e-40a69f9bc729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:38.002882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7db23a-7313-4fed-a27e-40a69f9bc729 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:38.006514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 438/871] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:59:37 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:59:38.022884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 434/872] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:38.028443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a6b9-f2b7-4211-a5d8-c6c64eec7222 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:38.063875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7db23a-7313-4fed-a27e-40a69f9bc729 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:38.096752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:38.163123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:38.177822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7db23a-7313-4fed-a27e-40a69f9bc729 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:38.185413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a6b9-f2b7-4211-a5d8-c6c64eec7222 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:38.220358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208bea9-5d0e-4d3e-972e-289afc7d9f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:38.220358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208bea9-5d0e-4d3e-972e-289afc7d9f3d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:38.220661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208bea9-5d0e-4d3e-972e-289afc7d9f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:38.220937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208bea9-5d0e-4d3e-972e-289afc7d9f3d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:38.221531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208bea9-5d0e-4d3e-972e-289afc7d9f3d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:38.224764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208bea9-5d0e-4d3e-972e-289afc7d9f3d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:38.234257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61033f1-5ab1-4681-a4f5-a82d490b152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:38.234917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61033f1-5ab1-4681-a4f5-a82d490b152e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:38.235195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61033f1-5ab1-4681-a4f5-a82d490b152e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:38.235466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61033f1-5ab1-4681-a4f5-a82d490b152e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0208bea9-5d0e-4d3e-972e-289afc7d9f3d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:38.236416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:38.237403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:38.238302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 435/873] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:38.245190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208bea9-5d0e-4d3e-972e-289afc7d9f3d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:38.246749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61033f1-5ab1-4681-a4f5-a82d490b152e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:38.248228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61033f1-5ab1-4681-a4f5-a82d490b152e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c61033f1-5ab1-4681-a4f5-a82d490b152e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:38.264470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:38.265406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:38.271506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:38.271506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:38.271506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:38.271506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:38.271506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:38.271506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:38.271506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:38.271506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:38.271506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 439/874] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:38.274077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61033f1-5ab1-4681-a4f5-a82d490b152e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:38.378975 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208bea9-5d0e-4d3e-972e-289afc7d9f3d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:38.380511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61033f1-5ab1-4681-a4f5-a82d490b152e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:38.389073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:38.415594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701ea41-e171-4ea8-948e-11a79929cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:38.416221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701ea41-e171-4ea8-948e-11a79929cde0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:38.416512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701ea41-e171-4ea8-948e-11a79929cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:38.416763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701ea41-e171-4ea8-948e-11a79929cde0 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:38.417491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701ea41-e171-4ea8-948e-11a79929cde0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:38.417820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701ea41-e171-4ea8-948e-11a79929cde0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:38.418667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e79bc-58c4-4c88-9b84-e6f1b2466da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:38.419178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701ea41-e171-4ea8-948e-11a79929cde0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:38.419277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e79bc-58c4-4c88-9b84-e6f1b2466da6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:38.419531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e79bc-58c4-4c88-9b84-e6f1b2466da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:38.419801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e79bc-58c4-4c88-9b84-e6f1b2466da6 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:38.420479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e79bc-58c4-4c88-9b84-e6f1b2466da6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:38.420780 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e79bc-58c4-4c88-9b84-e6f1b2466da6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:38.422214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e79bc-58c4-4c88-9b84-e6f1b2466da6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:38.425683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 436/875] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 19 11:59:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:38.425683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eb4ca-f2c8-452d-9165-e04089939ff4 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:38.425683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eb4ca-f2c8-452d-9165-e04089939ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:38.425972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eb4ca-f2c8-452d-9165-e04089939ff4 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:38.431098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 437/876] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:38.432389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313eb4ca-f2c8-452d-9165-e04089939ff4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:38.440049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 440/877] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:38.446086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954a16-3345-40e0-b393-d027c9173cad None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:38.446371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954a16-3345-40e0-b393-d027c9173cad None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:38.446641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954a16-3345-40e0-b393-d027c9173cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:38.451990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:38.465591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1b954a16-3345-40e0-b393-d027c9173cad None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:38.466858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1b954a16-3345-40e0-b393-d027c9173cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:38.537683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313eb4ca-f2c8-452d-9165-e04089939ff4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:38.538165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 441/878] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:38.538923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b954a16-3345-40e0-b393-d027c9173cad None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:38.590642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7cd70-ca01-4c1a-bf20-090866060c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:38.592058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7cd70-ca01-4c1a-bf20-090866060c65 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:38.592541 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7cd70-ca01-4c1a-bf20-090866060c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:38.593071 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7cd70-ca01-4c1a-bf20-090866060c65 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:38.593941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7cd70-ca01-4c1a-bf20-090866060c65 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:38.595005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7cd70-ca01-4c1a-bf20-090866060c65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:38.596552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7cd70-ca01-4c1a-bf20-090866060c65 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:38.606032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 438/879] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 19 11:59:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:38.645320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:38.652835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b954a16-3345-40e0-b393-d027c9173cad None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:38.691043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e98a3e-98e4-4c72-a0f8-9ee89e296f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:38.691661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98a3e-98e4-4c72-a0f8-9ee89e296f56 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:38.691937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98a3e-98e4-4c72-a0f8-9ee89e296f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:38.692203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98a3e-98e4-4c72-a0f8-9ee89e296f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:38.692932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e98a3e-98e4-4c72-a0f8-9ee89e296f56 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=42d7224dbe7944789327082192495039) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:38.693235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e98a3e-98e4-4c72-a0f8-9ee89e296f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:38.694709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e98a3e-98e4-4c72-a0f8-9ee89e296f56 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:38.702352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 442/880] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:38 2022] GET /identity/v3/role_assignments?user.id=42d7224dbe7944789327082192495039&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:38.812467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7cd70-ca01-4c1a-bf20-090866060c65 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:38.902058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:38.923233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7cd70-ca01-4c1a-bf20-090866060c65 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:38.959760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa321b5-04e5-49db-aecc-495d978cbd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:38.960708 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa321b5-04e5-49db-aecc-495d978cbd39 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:38.960986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa321b5-04e5-49db-aecc-495d978cbd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:38.961255 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa321b5-04e5-49db-aecc-495d978cbd39 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:38.961939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa321b5-04e5-49db-aecc-495d978cbd39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:38.963425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa321b5-04e5-49db-aecc-495d978cbd39 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:38.983325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 439/881] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:59:38 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:59:40.333924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e613d-fd0c-4221-96a4-137d411f4993 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:40.334446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e613d-fd0c-4221-96a4-137d411f4993 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:40.334446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e613d-fd0c-4221-96a4-137d411f4993 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:40.336208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 443/882] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:40.343029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ed59b-9eec-4815-af4b-98108cabb49b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:40.343834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ed59b-9eec-4815-af4b-98108cabb49b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:40.344303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ed59b-9eec-4815-af4b-98108cabb49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:40.362990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-019ed59b-9eec-4815-af4b-98108cabb49b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:40.364490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-019ed59b-9eec-4815-af4b-98108cabb49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:40.440203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 440/883] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:40.712324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e613d-fd0c-4221-96a4-137d411f4993 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:40.821559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e613d-fd0c-4221-96a4-137d411f4993 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:40.859637 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9ce35-7ee7-4147-bd74-57550058df84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:40.860266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9ce35-7ee7-4147-bd74-57550058df84 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:40.860543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9ce35-7ee7-4147-bd74-57550058df84 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:40.860813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9ce35-7ee7-4147-bd74-57550058df84 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:40.861385 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9ce35-7ee7-4147-bd74-57550058df84 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:40.862758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9ce35-7ee7-4147-bd74-57550058df84 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-4cd9ce35-7ee7-4147-bd74-57550058df84 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:40.872195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:40.873184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:59:40.874029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:40.877731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 444/884] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:59:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:40.879555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ed59b-9eec-4815-af4b-98108cabb49b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:40.928764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af580a8-c6de-40a4-8f2e-7bf6ed28de46 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:40.929375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af580a8-c6de-40a4-8f2e-7bf6ed28de46 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:40.929903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af580a8-c6de-40a4-8f2e-7bf6ed28de46 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:40.932367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 445/885] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:40.938455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3e0ad-5ea6-45fb-b52e-ff9cfa1f6238 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:40.939079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3e0ad-5ea6-45fb-b52e-ff9cfa1f6238 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:40.939593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3e0ad-5ea6-45fb-b52e-ff9cfa1f6238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:40.957236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:40.965369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-37c3e0ad-5ea6-45fb-b52e-ff9cfa1f6238 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:40.966919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-37c3e0ad-5ea6-45fb-b52e-ff9cfa1f6238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:40.986476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:41.006589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ed59b-9eec-4815-af4b-98108cabb49b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:41.049802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 446/886] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:41.051634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f04bd-6104-4c7f-a4b0-72bd578fac07 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.051923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f04bd-6104-4c7f-a4b0-72bd578fac07 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.052198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f04bd-6104-4c7f-a4b0-72bd578fac07 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.053758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 447/887] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:41.059465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3dfe-4672-4061-8cc2-aca97fddeadf None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.059611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e396d5-769a-4316-81cf-c909889fb645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:41.059834 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3dfe-4672-4061-8cc2-aca97fddeadf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.060022 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3dfe-4672-4061-8cc2-aca97fddeadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.060127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e396d5-769a-4316-81cf-c909889fb645 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.060341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e396d5-769a-4316-81cf-c909889fb645 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.060602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e396d5-769a-4316-81cf-c909889fb645 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.061236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e396d5-769a-4316-81cf-c909889fb645 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:41.061536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e396d5-769a-4316-81cf-c909889fb645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:41.062938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e396d5-769a-4316-81cf-c909889fb645 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:41.068429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 441/888] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:59:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:41.075271 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e396d5-769a-4316-81cf-c909889fb645 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:41.088473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-017d3dfe-4672-4061-8cc2-aca97fddeadf None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:41.089745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-017d3dfe-4672-4061-8cc2-aca97fddeadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:41.167006 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 448/889] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:41.188387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e396d5-769a-4316-81cf-c909889fb645 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:41.216779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:41.222688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320e19-3ed3-4f19-85d7-b9455c74c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:41.223617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320e19-3ed3-4f19-85d7-b9455c74c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.223897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320e19-3ed3-4f19-85d7-b9455c74c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.224303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320e19-3ed3-4f19-85d7-b9455c74c9f4 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.225000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84320e19-3ed3-4f19-85d7-b9455c74c9f4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:41.225715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84320e19-3ed3-4f19-85d7-b9455c74c9f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:41.227461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84320e19-3ed3-4f19-85d7-b9455c74c9f4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:41.233732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 442/890] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:59:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:41.242803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3dfe-4672-4061-8cc2-aca97fddeadf None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:41.271687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e734-3c9f-4282-9d51-304bf70f9e4b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.271975 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e734-3c9f-4282-9d51-304bf70f9e4b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.272256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e734-3c9f-4282-9d51-304bf70f9e4b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.273743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 443/891] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:41.280492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d31ff5-ffc9-4bb3-ba20-3c7f95a3ac2c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.280778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d31ff5-ffc9-4bb3-ba20-3c7f95a3ac2c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.281052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d31ff5-ffc9-4bb3-ba20-3c7f95a3ac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.300770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-03d31ff5-ffc9-4bb3-ba20-3c7f95a3ac2c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:41.301994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-03d31ff5-ffc9-4bb3-ba20-3c7f95a3ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:41.336528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:41.357456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3dfe-4672-4061-8cc2-aca97fddeadf None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:41.380222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 444/892] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:41.381185 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d31ff5-ffc9-4bb3-ba20-3c7f95a3ac2c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:41.399987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe0e0b-a8e0-471a-ad8e-eeea67ca92df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:41.401015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe0e0b-a8e0-471a-ad8e-eeea67ca92df None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.401536 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe0e0b-a8e0-471a-ad8e-eeea67ca92df None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.401997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe0e0b-a8e0-471a-ad8e-eeea67ca92df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.402832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe0e0b-a8e0-471a-ad8e-eeea67ca92df None admin] RBAC: Adding query filter params (interface=public, service_id=a11cc6a309eb4a2a8d3bb19750f590fc, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:41.403304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe0e0b-a8e0-471a-ad8e-eeea67ca92df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:41.405424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe0e0b-a8e0-471a-ad8e-eeea67ca92df None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:41.416638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 449/893] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 19 11:59:41 2022] GET /identity/v3/endpoints?service_id=a11cc6a309eb4a2a8d3bb19750f590fc&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:41.418126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe0e0b-a8e0-471a-ad8e-eeea67ca92df None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:41.494198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d31ff5-ffc9-4bb3-ba20-3c7f95a3ac2c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:41.517053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:41.523666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe0e0b-a8e0-471a-ad8e-eeea67ca92df None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:41.528659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1af02-edc3-4f80-ae8b-4c3a8d5c178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:41.529267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1af02-edc3-4f80-ae8b-4c3a8d5c178e None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.529545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1af02-edc3-4f80-ae8b-4c3a8d5c178e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.529845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1af02-edc3-4f80-ae8b-4c3a8d5c178e None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.530494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1af02-edc3-4f80-ae8b-4c3a8d5c178e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:41.531887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1af02-edc3-4f80-ae8b-4c3a8d5c178e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:41.546112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 445/894] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:59:41 2022] POST /identity/v3/services => generated 241 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:59:41.554737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1af02-edc3-4f80-ae8b-4c3a8d5c178e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:41.575255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828dcc4-eeb4-45aa-aeb8-11547aae116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:41.575881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828dcc4-eeb4-45aa-aeb8-11547aae116f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.576175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828dcc4-eeb4-45aa-aeb8-11547aae116f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.576715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828dcc4-eeb4-45aa-aeb8-11547aae116f None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.577359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828dcc4-eeb4-45aa-aeb8-11547aae116f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:41.579683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828dcc4-eeb4-45aa-aeb8-11547aae116f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:41.594009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 450/895] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 19 11:59:41 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:59:41.665889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828dcc4-eeb4-45aa-aeb8-11547aae116f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:41.683605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:41.694785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1af02-edc3-4f80-ae8b-4c3a8d5c178e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:41.748297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df9fe-c3a9-4610-80eb-90882324dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:41.749796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df9fe-c3a9-4610-80eb-90882324dc05 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.750082 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df9fe-c3a9-4610-80eb-90882324dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.750356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df9fe-c3a9-4610-80eb-90882324dc05 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.763687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312df9fe-c3a9-4610-80eb-90882324dc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-312df9fe-c3a9-4610-80eb-90882324dc05 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:41.769285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:41.770511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:41.771608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 446/896] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 19 11:59:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:41.777825 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df9fe-c3a9-4610-80eb-90882324dc05 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:41.804864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828dcc4-eeb4-45aa-aeb8-11547aae116f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:41.839310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:41.854864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f655fd-c8a7-4226-8a17-46238b7a8eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:41.855657 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f655fd-c8a7-4226-8a17-46238b7a8eff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.855935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f655fd-c8a7-4226-8a17-46238b7a8eff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.856229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f655fd-c8a7-4226-8a17-46238b7a8eff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.857165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f655fd-c8a7-4226-8a17-46238b7a8eff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:41.858562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f655fd-c8a7-4226-8a17-46238b7a8eff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-45f655fd-c8a7-4226-8a17-46238b7a8eff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:41.868060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:41.869020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:41.870192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 451/897] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Sep 19 11:59:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:41.875323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f655fd-c8a7-4226-8a17-46238b7a8eff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:41.919014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df9fe-c3a9-4610-80eb-90882324dc05 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:41.951816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:41.970202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3a6d1-a5bf-48e7-9e85-4caeadc5c949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:41.971075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3a6d1-a5bf-48e7-9e85-4caeadc5c949 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:41.972013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3a6d1-a5bf-48e7-9e85-4caeadc5c949 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:41.972446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3a6d1-a5bf-48e7-9e85-4caeadc5c949 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:41.973798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3a6d1-a5bf-48e7-9e85-4caeadc5c949 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:41.974484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3a6d1-a5bf-48e7-9e85-4caeadc5c949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:41.976808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3a6d1-a5bf-48e7-9e85-4caeadc5c949 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:41.985127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f655fd-c8a7-4226-8a17-46238b7a8eff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:41.989780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 447/898] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 19 11:59:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:41.997668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3a6d1-a5bf-48e7-9e85-4caeadc5c949 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:42.024004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39766e8-6a9d-4c9f-a9e3-5152ab8d3900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:42.024858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39766e8-6a9d-4c9f-a9e3-5152ab8d3900 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:42.025291 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39766e8-6a9d-4c9f-a9e3-5152ab8d3900 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:42.025972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39766e8-6a9d-4c9f-a9e3-5152ab8d3900 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:42.026857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39766e8-6a9d-4c9f-a9e3-5152ab8d3900 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:42.027311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39766e8-6a9d-4c9f-a9e3-5152ab8d3900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:42.028890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39766e8-6a9d-4c9f-a9e3-5152ab8d3900 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:42.038682 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 452/899] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:42.039774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39766e8-6a9d-4c9f-a9e3-5152ab8d3900 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:42.106097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3a6d1-a5bf-48e7-9e85-4caeadc5c949 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:42.113496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:42.143896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534763-be55-47e9-8bc9-f479c81fd573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:42.144746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534763-be55-47e9-8bc9-f479c81fd573 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:42.144866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534763-be55-47e9-8bc9-f479c81fd573 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:42.145168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534763-be55-47e9-8bc9-f479c81fd573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:42.151175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39766e8-6a9d-4c9f-a9e3-5152ab8d3900 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:42.157531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc534763-be55-47e9-8bc9-f479c81fd573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:42.159068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc534763-be55-47e9-8bc9-f479c81fd573 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-bc534763-be55-47e9-8bc9-f479c81fd573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:42.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:42.176968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:42.178129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:42.178129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:42.178129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:42.178129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 448/900] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:42.183012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534763-be55-47e9-8bc9-f479c81fd573 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:42.193130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d53b-24d4-445e-baa0-dfbabcfe3749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:42.193983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d53b-24d4-445e-baa0-dfbabcfe3749 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:42.194411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d53b-24d4-445e-baa0-dfbabcfe3749 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:42.194840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d53b-24d4-445e-baa0-dfbabcfe3749 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:42.195616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598d53b-24d4-445e-baa0-dfbabcfe3749 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:42.196069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598d53b-24d4-445e-baa0-dfbabcfe3749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:42.197668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598d53b-24d4-445e-baa0-dfbabcfe3749 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:42.200436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:42.209495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 453/901] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:42.210602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d53b-24d4-445e-baa0-dfbabcfe3749 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:42.306586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534763-be55-47e9-8bc9-f479c81fd573 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:42.336904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d53b-24d4-445e-baa0-dfbabcfe3749 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:42.355256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3eb0-03d1-4cba-a794-642bb7f11492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:42.356127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3eb0-03d1-4cba-a794-642bb7f11492 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:42.356409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3eb0-03d1-4cba-a794-642bb7f11492 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:42.356679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3eb0-03d1-4cba-a794-642bb7f11492 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:42.357321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3eb0-03d1-4cba-a794-642bb7f11492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:42.357651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3eb0-03d1-4cba-a794-642bb7f11492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:42.359690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3eb0-03d1-4cba-a794-642bb7f11492 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:42.376577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 449/902] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:42.381828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3eb0-03d1-4cba-a794-642bb7f11492 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:42.383047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2010bc-e3ff-4b6c-852f-39d4223406ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:42.383832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2010bc-e3ff-4b6c-852f-39d4223406ba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:42.384257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2010bc-e3ff-4b6c-852f-39d4223406ba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:42.384749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2010bc-e3ff-4b6c-852f-39d4223406ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:42.385996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2010bc-e3ff-4b6c-852f-39d4223406ba None admin] RBAC: Adding query filter params (interface=public, service_id=5ed555d0fa7948a3a2cbcb99507d7909, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:42.386452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2010bc-e3ff-4b6c-852f-39d4223406ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:42.387983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2010bc-e3ff-4b6c-852f-39d4223406ba None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:42.395542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 454/903] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 19 11:59:42 2022] GET /identity/v3/endpoints?service_id=5ed555d0fa7948a3a2cbcb99507d7909&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:42.401882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2010bc-e3ff-4b6c-852f-39d4223406ba None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:42.406614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:42.480465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:42.518854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3eb0-03d1-4cba-a794-642bb7f11492 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:42.530209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2010bc-e3ff-4b6c-852f-39d4223406ba None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:42.570751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e61eac-b1ae-4c17-a09b-86835a07c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:42.571661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e61eac-b1ae-4c17-a09b-86835a07c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:42.572088 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e61eac-b1ae-4c17-a09b-86835a07c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:42.572555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e61eac-b1ae-4c17-a09b-86835a07c9a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:42.580346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99490220-f8e7-4f68-b0d8-d1aeed523a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:42.581122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490220-f8e7-4f68-b0d8-d1aeed523a61 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:42.581539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490220-f8e7-4f68-b0d8-d1aeed523a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:42.581908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490220-f8e7-4f68-b0d8-d1aeed523a61 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:42.582591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e61eac-b1ae-4c17-a09b-86835a07c9a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:42.582728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99490220-f8e7-4f68-b0d8-d1aeed523a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:42.584174 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99490220-f8e7-4f68-b0d8-d1aeed523a61 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:42.584479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e61eac-b1ae-4c17-a09b-86835a07c9a2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d6e61eac-b1ae-4c17-a09b-86835a07c9a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:42.597378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:42.598787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:42.599797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:42.599797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:42.599797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:42.599797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:42.599797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:42.599797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:42.599797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:42.599797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:42.599797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:42.599797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:42.600316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 455/904] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 19 11:59:42 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:59:42.602012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 450/905] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 19 11:59:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:42.615099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99490220-f8e7-4f68-b0d8-d1aeed523a61 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:42.731031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99490220-f8e7-4f68-b0d8-d1aeed523a61 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:42.762001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:42.771671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ed410-73c6-458d-966b-4a0d96f2fdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:42.773895 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed410-73c6-458d-966b-4a0d96f2fdca None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:42.773895 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed410-73c6-458d-966b-4a0d96f2fdca None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:42.773895 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed410-73c6-458d-966b-4a0d96f2fdca None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:42.773895 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ed410-73c6-458d-966b-4a0d96f2fdca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:42.774189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ed410-73c6-458d-966b-4a0d96f2fdca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:42.776894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ed410-73c6-458d-966b-4a0d96f2fdca None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:42.795109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 456/906] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 19 11:59:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:42.800751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e61eac-b1ae-4c17-a09b-86835a07c9a2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:42.889770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:42.910190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e61eac-b1ae-4c17-a09b-86835a07c9a2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:42.944985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb68ce-2a21-4b54-9209-aef5f3ba5206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:42.945594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb68ce-2a21-4b54-9209-aef5f3ba5206 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:42.945894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb68ce-2a21-4b54-9209-aef5f3ba5206 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:42.946163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb68ce-2a21-4b54-9209-aef5f3ba5206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:43.016616 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb68ce-2a21-4b54-9209-aef5f3ba5206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:43.018091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb68ce-2a21-4b54-9209-aef5f3ba5206 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:43.094873 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:43.118038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 451/907] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:42 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:59:43.124170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ed410-73c6-458d-966b-4a0d96f2fdca None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:43.226782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ed410-73c6-458d-966b-4a0d96f2fdca None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:43.265770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcf9d5-3464-44de-80bd-21592a6d3c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:43.266414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcf9d5-3464-44de-80bd-21592a6d3c8f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:43.266696 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcf9d5-3464-44de-80bd-21592a6d3c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:43.266969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcf9d5-3464-44de-80bd-21592a6d3c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:43.277879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcf9d5-3464-44de-80bd-21592a6d3c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:43.279415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcf9d5-3464-44de-80bd-21592a6d3c8f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-51dcf9d5-3464-44de-80bd-21592a6d3c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:43.294425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:43.295382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:43.296778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:43.296778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:43.296778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:43.296778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 457/908] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:43.301188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb68ce-2a21-4b54-9209-aef5f3ba5206 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:43.407709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb68ce-2a21-4b54-9209-aef5f3ba5206 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:43.442529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cf2c9-53b5-4bcb-bf0f-78879a90a3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:43.443130 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cf2c9-53b5-4bcb-bf0f-78879a90a3dc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:43.443406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cf2c9-53b5-4bcb-bf0f-78879a90a3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:43.443674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cf2c9-53b5-4bcb-bf0f-78879a90a3dc None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:43.444309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cf2c9-53b5-4bcb-bf0f-78879a90a3dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:43.444608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cf2c9-53b5-4bcb-bf0f-78879a90a3dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:43.446035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cf2c9-53b5-4bcb-bf0f-78879a90a3dc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:43.459818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 452/909] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:43.466134 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcf9d5-3464-44de-80bd-21592a6d3c8f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:43.507446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:43.570264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcf9d5-3464-44de-80bd-21592a6d3c8f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:43.609184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b847d-9f6c-4432-8e2a-28c6af00972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:43.609866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b847d-9f6c-4432-8e2a-28c6af00972c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:43.610147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b847d-9f6c-4432-8e2a-28c6af00972c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:43.610421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b847d-9f6c-4432-8e2a-28c6af00972c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:43.617716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b847d-9f6c-4432-8e2a-28c6af00972c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:43.619158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b847d-9f6c-4432-8e2a-28c6af00972c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-814b847d-9f6c-4432-8e2a-28c6af00972c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:43.630927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:43.631804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:43.633268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:43.633268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:43.633268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:43.633268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:43.633268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:43.633268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:43.633268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:43.633268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:43.633268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 458/910] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:43.637778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cf2c9-53b5-4bcb-bf0f-78879a90a3dc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:43.702054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:43.766364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cf2c9-53b5-4bcb-bf0f-78879a90a3dc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:43.809916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9ceea-4775-4ad5-8735-ca6bd29de406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:43.810949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ceea-4775-4ad5-8735-ca6bd29de406 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:43.811424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ceea-4775-4ad5-8735-ca6bd29de406 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:43.811904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ceea-4775-4ad5-8735-ca6bd29de406 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:43.812789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9ceea-4775-4ad5-8735-ca6bd29de406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:43.813292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9ceea-4775-4ad5-8735-ca6bd29de406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:43.815015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9ceea-4775-4ad5-8735-ca6bd29de406 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:43.828579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 453/911] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:43.836464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b847d-9f6c-4432-8e2a-28c6af00972c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:43.878174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2d852-112f-4727-9005-7647dc205c62 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:43.878835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2d852-112f-4727-9005-7647dc205c62 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:43.879324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2d852-112f-4727-9005-7647dc205c62 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:43.881150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 454/912] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:43.886036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337a43-9b8f-4152-b8e9-603403775c84 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:43.886323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337a43-9b8f-4152-b8e9-603403775c84 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:43.886600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337a43-9b8f-4152-b8e9-603403775c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:43.906819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-36337a43-9b8f-4152-b8e9-603403775c84 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:43.908001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-36337a43-9b8f-4152-b8e9-603403775c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:43.944189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:43.948380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b847d-9f6c-4432-8e2a-28c6af00972c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:43.986700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 455/913] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:43.987930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92019de9-7661-4ff5-a8e4-8694fafc3e30 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:43.988217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92019de9-7661-4ff5-a8e4-8694fafc3e30 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:43.988487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92019de9-7661-4ff5-a8e4-8694fafc3e30 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:43.994160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 456/914] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:43.995147 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7cdd-a88d-4fa1-95cc-3bfa98381da5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:43.995430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7cdd-a88d-4fa1-95cc-3bfa98381da5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:43.995703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7cdd-a88d-4fa1-95cc-3bfa98381da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:43.998992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba3f8a-6f7a-4a78-939e-9f520bbe95cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:43.999616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba3f8a-6f7a-4a78-939e-9f520bbe95cd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:43.999901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba3f8a-6f7a-4a78-939e-9f520bbe95cd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:44.000177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba3f8a-6f7a-4a78-939e-9f520bbe95cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:44.000905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba3f8a-6f7a-4a78-939e-9f520bbe95cd None admin] RBAC: Adding query filter params (role.id=60dc3e6f759b4f9f9b5bab5fc1be0d0e, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=42d7224dbe7944789327082192495039) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:44.001219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba3f8a-6f7a-4a78-939e-9f520bbe95cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:44.002673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba3f8a-6f7a-4a78-939e-9f520bbe95cd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:44.013995 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 459/915] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:43 2022] GET /identity/v3/role_assignments?user.id=42d7224dbe7944789327082192495039&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=60dc3e6f759b4f9f9b5bab5fc1be0d0e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:44.018756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d33c7cdd-a88d-4fa1-95cc-3bfa98381da5 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:44.019914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d33c7cdd-a88d-4fa1-95cc-3bfa98381da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:44.047704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:44.099012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 457/916] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:44.268013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba3f8a-6f7a-4a78-939e-9f520bbe95cd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:44.372601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba3f8a-6f7a-4a78-939e-9f520bbe95cd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:44.398452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c7cdd-a88d-4fa1-95cc-3bfa98381da5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:44.411957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080984bf-b980-4a79-9a0a-77da60477a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:44.412926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080984bf-b980-4a79-9a0a-77da60477a80 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:44.413417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080984bf-b980-4a79-9a0a-77da60477a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:44.413990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080984bf-b980-4a79-9a0a-77da60477a80 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:44.414887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080984bf-b980-4a79-9a0a-77da60477a80 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:44.417301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080984bf-b980-4a79-9a0a-77da60477a80 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-080984bf-b980-4a79-9a0a-77da60477a80 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:44.427143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:44.428136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:59:44.428966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:44.436196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 460/917] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:59:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:44.437097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080984bf-b980-4a79-9a0a-77da60477a80 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:44.467749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:44.530593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c7cdd-a88d-4fa1-95cc-3bfa98381da5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:44.554659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080984bf-b980-4a79-9a0a-77da60477a80 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:44.567744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade11e4d-b1c2-4f5a-93f8-4e9bd70d2817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:44.568384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11e4d-b1c2-4f5a-93f8-4e9bd70d2817 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:44.568663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11e4d-b1c2-4f5a-93f8-4e9bd70d2817 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:44.569041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11e4d-b1c2-4f5a-93f8-4e9bd70d2817 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:44.569794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade11e4d-b1c2-4f5a-93f8-4e9bd70d2817 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:44.571170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade11e4d-b1c2-4f5a-93f8-4e9bd70d2817 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ade11e4d-b1c2-4f5a-93f8-4e9bd70d2817 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:44.581273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:44.582323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:44.583783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 458/918] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:44.588586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade11e4d-b1c2-4f5a-93f8-4e9bd70d2817 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:44.591876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf972327-188e-4a74-ba44-997e8111cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:44.592621 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf972327-188e-4a74-ba44-997e8111cece None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:44.592902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf972327-188e-4a74-ba44-997e8111cece None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:44.593173 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf972327-188e-4a74-ba44-997e8111cece None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:44.593836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf972327-188e-4a74-ba44-997e8111cece None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:44.594137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf972327-188e-4a74-ba44-997e8111cece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:44.595562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf972327-188e-4a74-ba44-997e8111cece None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:44.606799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 461/919] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:59:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:44.607685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf972327-188e-4a74-ba44-997e8111cece None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:44.614779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:44.699024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade11e4d-b1c2-4f5a-93f8-4e9bd70d2817 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:44.713416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:44.724906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf972327-188e-4a74-ba44-997e8111cece None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:44.737132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59764-faa7-45ba-9d0c-62ca4357c2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:44.737688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59764-faa7-45ba-9d0c-62ca4357c2cb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:44.737976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59764-faa7-45ba-9d0c-62ca4357c2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:44.738252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59764-faa7-45ba-9d0c-62ca4357c2cb None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:44.738883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59764-faa7-45ba-9d0c-62ca4357c2cb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:44.739190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59764-faa7-45ba-9d0c-62ca4357c2cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:44.740679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59764-faa7-45ba-9d0c-62ca4357c2cb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:44.751757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 459/920] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 19 11:59:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:44.752738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59764-faa7-45ba-9d0c-62ca4357c2cb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:44.764646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242c960-71d8-461a-952c-e639fbcdd56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:44.765636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242c960-71d8-461a-952c-e639fbcdd56e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:44.766063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242c960-71d8-461a-952c-e639fbcdd56e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:44.766551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242c960-71d8-461a-952c-e639fbcdd56e None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:44.767386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242c960-71d8-461a-952c-e639fbcdd56e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:44.767841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242c960-71d8-461a-952c-e639fbcdd56e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:44.769602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242c960-71d8-461a-952c-e639fbcdd56e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:44.780108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 462/921] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 19 11:59:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:44.781161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242c960-71d8-461a-952c-e639fbcdd56e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:44.844845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:44.864042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59764-faa7-45ba-9d0c-62ca4357c2cb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:44.897109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242c960-71d8-461a-952c-e639fbcdd56e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:44.903566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb851438-0422-4cca-aefc-8c08a56dd4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:44.904197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb851438-0422-4cca-aefc-8c08a56dd4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:44.904477 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb851438-0422-4cca-aefc-8c08a56dd4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:44.904748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb851438-0422-4cca-aefc-8c08a56dd4e7 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:44.905394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb851438-0422-4cca-aefc-8c08a56dd4e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:44.905731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb851438-0422-4cca-aefc-8c08a56dd4e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:44.907273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb851438-0422-4cca-aefc-8c08a56dd4e7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:44.918044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 460/922] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 19 11:59:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:44.920271 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb851438-0422-4cca-aefc-8c08a56dd4e7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:44.938525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f554a1-c797-40de-a206-a1bcd4f6668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:44.939642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f554a1-c797-40de-a206-a1bcd4f6668b None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:44.940115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f554a1-c797-40de-a206-a1bcd4f6668b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:44.941048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f554a1-c797-40de-a206-a1bcd4f6668b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:44.941901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f554a1-c797-40de-a206-a1bcd4f6668b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:44.943941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f554a1-c797-40de-a206-a1bcd4f6668b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:44.978103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 463/923] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 11:59:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:59:44.990009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc168c5-0509-4e65-acc9-88d0d9f62f3a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:44.990444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc168c5-0509-4e65-acc9-88d0d9f62f3a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:44.990815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc168c5-0509-4e65-acc9-88d0d9f62f3a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:44.996751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 464/924] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:44.998751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b918fec-827e-424c-ab01-f08f077f061c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:44.999037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b918fec-827e-424c-ab01-f08f077f061c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:44.999301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b918fec-827e-424c-ab01-f08f077f061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:45.019542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8b918fec-827e-424c-ab01-f08f077f061c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:45.020750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8b918fec-827e-424c-ab01-f08f077f061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:45.025126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:45.046918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb851438-0422-4cca-aefc-8c08a56dd4e7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:45.095367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fefe43-51e3-4b53-9747-b62a20f827b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:45.096017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fefe43-51e3-4b53-9747-b62a20f827b1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:45.096343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fefe43-51e3-4b53-9747-b62a20f827b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:45.096616 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fefe43-51e3-4b53-9747-b62a20f827b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:45.097412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fefe43-51e3-4b53-9747-b62a20f827b1 None admin] RBAC: Adding query filter params (interface=public, service_id=ac4040c97c394f3c8c902a1dcba3fe32, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:45.097800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fefe43-51e3-4b53-9747-b62a20f827b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:45.099444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fefe43-51e3-4b53-9747-b62a20f827b1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:45.110542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 461/925] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 19 11:59:44 2022] GET /identity/v3/endpoints?service_id=ac4040c97c394f3c8c902a1dcba3fe32&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:45.112107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fefe43-51e3-4b53-9747-b62a20f827b1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:45.122282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 465/926] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:45.130969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:45.233155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fefe43-51e3-4b53-9747-b62a20f827b1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:45.268935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdc2fc-d0e0-49a3-aa3b-d88934f0137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:45.269611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdc2fc-d0e0-49a3-aa3b-d88934f0137d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:45.269911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdc2fc-d0e0-49a3-aa3b-d88934f0137d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:45.270186 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdc2fc-d0e0-49a3-aa3b-d88934f0137d None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:45.270787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdc2fc-d0e0-49a3-aa3b-d88934f0137d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:45.272152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdc2fc-d0e0-49a3-aa3b-d88934f0137d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:45.285816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 462/927] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 19 11:59:45 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:59:45.409844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b918fec-827e-424c-ab01-f08f077f061c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:45.517471 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b918fec-827e-424c-ab01-f08f077f061c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:45.553524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb08618-4aff-4b49-86ee-fcfa83959f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:45.554537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08618-4aff-4b49-86ee-fcfa83959f7a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:45.555043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08618-4aff-4b49-86ee-fcfa83959f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:45.555534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08618-4aff-4b49-86ee-fcfa83959f7a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:45.556318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb08618-4aff-4b49-86ee-fcfa83959f7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:45.558277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb08618-4aff-4b49-86ee-fcfa83959f7a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0eb08618-4aff-4b49-86ee-fcfa83959f7a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:45.567510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:45.568467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:59:45.569342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:45.572103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 466/928] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Sep 19 11:59:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:45.578630 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdc2fc-d0e0-49a3-aa3b-d88934f0137d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:45.660691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:45.692038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdc2fc-d0e0-49a3-aa3b-d88934f0137d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:45.729534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da842-1436-429e-a5f4-6e28d654e54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:45.730522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da842-1436-429e-a5f4-6e28d654e54d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:45.731028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da842-1436-429e-a5f4-6e28d654e54d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:45.731508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da842-1436-429e-a5f4-6e28d654e54d None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:45.732328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983da842-1436-429e-a5f4-6e28d654e54d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:45.732824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983da842-1436-429e-a5f4-6e28d654e54d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:45.734468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983da842-1436-429e-a5f4-6e28d654e54d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:45.740427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 463/929] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:45.745978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb08618-4aff-4b49-86ee-fcfa83959f7a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:45.749863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:45.854484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb08618-4aff-4b49-86ee-fcfa83959f7a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:45.889806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c84fe3-9731-46ca-ab2a-41002d99d743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:45.890419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84fe3-9731-46ca-ab2a-41002d99d743 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:45.890699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84fe3-9731-46ca-ab2a-41002d99d743 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:45.890970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84fe3-9731-46ca-ab2a-41002d99d743 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:45.891594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c84fe3-9731-46ca-ab2a-41002d99d743 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:45.891899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c84fe3-9731-46ca-ab2a-41002d99d743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:45.893257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c84fe3-9731-46ca-ab2a-41002d99d743 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:45.898602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 467/930] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:45.904983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da842-1436-429e-a5f4-6e28d654e54d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:46.018682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da842-1436-429e-a5f4-6e28d654e54d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:46.053457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38aace-c054-4b98-ad0f-3ff51dac5aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:46.054425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38aace-c054-4b98-ad0f-3ff51dac5aaf None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:46.054940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38aace-c054-4b98-ad0f-3ff51dac5aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:46.055402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38aace-c054-4b98-ad0f-3ff51dac5aaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:46.056263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38aace-c054-4b98-ad0f-3ff51dac5aaf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:46.058497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38aace-c054-4b98-ad0f-3ff51dac5aaf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:46.067489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:46.083430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 464/931] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 11:59:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:59:46.230009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df450f1a-a9d3-49a0-aa67-08c24d3f0bfb None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:46.230185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df450f1a-a9d3-49a0-aa67-08c24d3f0bfb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:46.230479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df450f1a-a9d3-49a0-aa67-08c24d3f0bfb None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:46.232132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 468/932] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:46.237974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0560612-7a56-46ad-9d6e-8247a1f8db69 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:46.238275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0560612-7a56-46ad-9d6e-8247a1f8db69 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:46.238528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0560612-7a56-46ad-9d6e-8247a1f8db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:46.258498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d0560612-7a56-46ad-9d6e-8247a1f8db69 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:46.259744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d0560612-7a56-46ad-9d6e-8247a1f8db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:46.340673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 465/933] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:46.611785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df450f1a-a9d3-49a0-aa67-08c24d3f0bfb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:46.681517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:46.718039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df450f1a-a9d3-49a0-aa67-08c24d3f0bfb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:46.753846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f345d-8459-4ef7-8072-18e9500eea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:46.754527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f345d-8459-4ef7-8072-18e9500eea4a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:46.754816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f345d-8459-4ef7-8072-18e9500eea4a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:46.755092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f345d-8459-4ef7-8072-18e9500eea4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:46.766135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f345d-8459-4ef7-8072-18e9500eea4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-be4f345d-8459-4ef7-8072-18e9500eea4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:46.770999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:46.771910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:46.772914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 469/934] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 19 11:59:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:46.778784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0560612-7a56-46ad-9d6e-8247a1f8db69 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:46.885842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0560612-7a56-46ad-9d6e-8247a1f8db69 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:46.907523 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:46.923530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e602bf-6da5-48bc-a916-c5866f8226dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:46.924562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e602bf-6da5-48bc-a916-c5866f8226dc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:46.924845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e602bf-6da5-48bc-a916-c5866f8226dc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:46.925124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e602bf-6da5-48bc-a916-c5866f8226dc None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:46.925831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e602bf-6da5-48bc-a916-c5866f8226dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:46.926120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e602bf-6da5-48bc-a916-c5866f8226dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:46.927657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e602bf-6da5-48bc-a916-c5866f8226dc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:46.936925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 466/935] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 19 11:59:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:46.942333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f345d-8459-4ef7-8072-18e9500eea4a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:47.046374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f345d-8459-4ef7-8072-18e9500eea4a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:47.075492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:47.085182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b908d77-d71c-4091-a98d-8af8aced297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:47.085896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b908d77-d71c-4091-a98d-8af8aced297c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.086181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b908d77-d71c-4091-a98d-8af8aced297c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.086457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b908d77-d71c-4091-a98d-8af8aced297c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.098641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b908d77-d71c-4091-a98d-8af8aced297c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:47.100093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b908d77-d71c-4091-a98d-8af8aced297c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8b908d77-d71c-4091-a98d-8af8aced297c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:47.115810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:47.116797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:47.117894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:47.117894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:47.117894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:47.117894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 470/936] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:47.123384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e602bf-6da5-48bc-a916-c5866f8226dc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:47.227883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e602bf-6da5-48bc-a916-c5866f8226dc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:47.263356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e349-edd1-4bbe-b59a-3833d713cfb5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.264021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e349-edd1-4bbe-b59a-3833d713cfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.264218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f5c77-07be-45fa-83a3-7f4ef9ea7a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:47.264718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e349-edd1-4bbe-b59a-3833d713cfb5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.264839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f5c77-07be-45fa-83a3-7f4ef9ea7a7b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.265040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f5c77-07be-45fa-83a3-7f4ef9ea7a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.265321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f5c77-07be-45fa-83a3-7f4ef9ea7a7b None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.265988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f5c77-07be-45fa-83a3-7f4ef9ea7a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:47.266293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f5c77-07be-45fa-83a3-7f4ef9ea7a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:47.270931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f5c77-07be-45fa-83a3-7f4ef9ea7a7b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:47.271199 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 471/937] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:47.272893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6d6ac-ab65-465d-a7f6-576a019c1fee None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.273376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6d6ac-ab65-465d-a7f6-576a019c1fee None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.273883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6d6ac-ab65-465d-a7f6-576a019c1fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.280408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 467/938] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:47.285482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f5c77-07be-45fa-83a3-7f4ef9ea7a7b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:47.293950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-91e6d6ac-ab65-465d-a7f6-576a019c1fee None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:47.295493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-91e6d6ac-ab65-465d-a7f6-576a019c1fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:47.333502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:47.385646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 472/939] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:47.399309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f5c77-07be-45fa-83a3-7f4ef9ea7a7b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:47.435634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ffda4-bd1d-4b70-ae8e-d0f00207bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:47.436281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ffda4-bd1d-4b70-ae8e-d0f00207bc9b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.436565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ffda4-bd1d-4b70-ae8e-d0f00207bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.436899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ffda4-bd1d-4b70-ae8e-d0f00207bc9b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.444412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ffda4-bd1d-4b70-ae8e-d0f00207bc9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:47.445893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ffda4-bd1d-4b70-ae8e-d0f00207bc9b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e12ffda4-bd1d-4b70-ae8e-d0f00207bc9b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:47.458080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:47.459041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:47.460318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 468/940] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 19 11:59:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:47.466860 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6d6ac-ab65-465d-a7f6-576a019c1fee None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:47.571666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6d6ac-ab65-465d-a7f6-576a019c1fee None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:47.582277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:47.607767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624df17-2c84-496c-9c76-1eee5ca80226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:47.608337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624df17-2c84-496c-9c76-1eee5ca80226 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.608616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624df17-2c84-496c-9c76-1eee5ca80226 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.608890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624df17-2c84-496c-9c76-1eee5ca80226 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.609613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624df17-2c84-496c-9c76-1eee5ca80226 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:47.609945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624df17-2c84-496c-9c76-1eee5ca80226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:47.611434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624df17-2c84-496c-9c76-1eee5ca80226 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:47.629205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 473/941] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 19 11:59:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:47.633399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70345f2-b359-4faa-ba3b-74b501aff880 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.633984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70345f2-b359-4faa-ba3b-74b501aff880 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.634272 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70345f2-b359-4faa-ba3b-74b501aff880 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.634642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624df17-2c84-496c-9c76-1eee5ca80226 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:47.636095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 469/942] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:47.641153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc4f80-3715-43cf-b600-e2d52e3e691c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.641440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc4f80-3715-43cf-b600-e2d52e3e691c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.641764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc4f80-3715-43cf-b600-e2d52e3e691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.666989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b7fc4f80-3715-43cf-b600-e2d52e3e691c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:47.668437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b7fc4f80-3715-43cf-b600-e2d52e3e691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:47.742274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624df17-2c84-496c-9c76-1eee5ca80226 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:47.745787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 470/943] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:47.746915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc4f80-3715-43cf-b600-e2d52e3e691c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:47.777233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e7d82-51af-400e-b4fb-a1819c43c79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:47.777959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7d82-51af-400e-b4fb-a1819c43c79b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.778257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7d82-51af-400e-b4fb-a1819c43c79b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.778697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7d82-51af-400e-b4fb-a1819c43c79b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.785791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:47.788755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e7d82-51af-400e-b4fb-a1819c43c79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:47.790777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e7d82-51af-400e-b4fb-a1819c43c79b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-4f3e7d82-51af-400e-b4fb-a1819c43c79b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:47.808280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:47.809243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:47.810137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:47.810137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:47.810137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:47.814198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 474/944] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:47.815057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e7d82-51af-400e-b4fb-a1819c43c79b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:47.840866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:47.888566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc4f80-3715-43cf-b600-e2d52e3e691c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:47.926791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:47.927184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.927463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.927731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.928421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:47.929822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:47.933222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WARNING keystone.server.flask.common [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 11:59:47.938547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e7d82-51af-400e-b4fb-a1819c43c79b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:47.951959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.sql.core [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:59:47.951959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 11:59:47.951959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [parameters: {'id': '20d658704db7487da0a0f426e6de098b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 11:59:47.951959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 20d658704db7487da0a0f426e6de098b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 20d658704db7487da0a0f426e6de098b. Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:59:47.960201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 19 11:59:47.961017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application yield resource Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise self.value Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application session.commit() Sep 19 11:59:47.967273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:59:47.968158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:59:47.969066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:59:47.969879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [parameters: {'id': '20d658704db7487da0a0f426e6de098b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:47.970750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:47.971511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:47.972382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:47.972382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 19 11:59:47.972382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 19 11:59:47.972382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:47.972382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:47.972382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 19 11:59:47.972382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 19 11:59:47.972382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 20d658704db7487da0a0f426e6de098b. Sep 19 11:59:47.972382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:47.972382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 471/945] 10.222.0.50 () {60 vars in 1140 bytes} [Mon Sep 19 11:59:47 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:47.976010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:47.991840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ed4ee-49d1-469e-afcb-39ddf4274e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:47.992588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed4ee-49d1-469e-afcb-39ddf4274e70 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.993110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed4ee-49d1-469e-afcb-39ddf4274e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.993419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed4ee-49d1-469e-afcb-39ddf4274e70 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.994774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ed4ee-49d1-469e-afcb-39ddf4274e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:47.994774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ed4ee-49d1-469e-afcb-39ddf4274e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:47.996262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ed4ee-49d1-469e-afcb-39ddf4274e70 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.015965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 475/946] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:48.015965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ed4ee-49d1-469e-afcb-39ddf4274e70 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.079986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:48.095093 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92360288-1ace-408b-b663-6683461bd7c3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.100812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:48.123492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ed4ee-49d1-469e-afcb-39ddf4274e70 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.130906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ad3d-b9ee-4e8b-a084-99b6b81f05cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.131602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ad3d-b9ee-4e8b-a084-99b6b81f05cf None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.131882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ad3d-b9ee-4e8b-a084-99b6b81f05cf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.132148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ad3d-b9ee-4e8b-a084-99b6b81f05cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.139800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0ad3d-b9ee-4e8b-a084-99b6b81f05cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.141551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0ad3d-b9ee-4e8b-a084-99b6b81f05cf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-65a0ad3d-b9ee-4e8b-a084-99b6b81f05cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:48.154019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:48.155068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:48.156161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:48.156161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:48.156161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:48.156161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:48.156161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:48.156161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:48.156161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:48.156161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:48.156161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 472/947] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:48.156659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ad3d-b9ee-4e8b-a084-99b6b81f05cf None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.169713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cf357-e1f6-4b18-bee4-7c13443e31d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.170415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf357-e1f6-4b18-bee4-7c13443e31d2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.170696 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf357-e1f6-4b18-bee4-7c13443e31d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.170968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf357-e1f6-4b18-bee4-7c13443e31d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.171577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cf357-e1f6-4b18-bee4-7c13443e31d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.172947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cf357-e1f6-4b18-bee4-7c13443e31d2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-998cf357-e1f6-4b18-bee4-7c13443e31d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:48.182424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:48.185838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:48.186804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 476/948] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:48.187592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cf357-e1f6-4b18-bee4-7c13443e31d2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.271615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ad3d-b9ee-4e8b-a084-99b6b81f05cf None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.293568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cf357-e1f6-4b18-bee4-7c13443e31d2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.312428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24cea-4abf-43bb-86d6-b2034d63e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.313090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24cea-4abf-43bb-86d6-b2034d63e513 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.313366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24cea-4abf-43bb-86d6-b2034d63e513 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.313654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24cea-4abf-43bb-86d6-b2034d63e513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.321078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e24cea-4abf-43bb-86d6-b2034d63e513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.323488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e24cea-4abf-43bb-86d6-b2034d63e513 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d8e24cea-4abf-43bb-86d6-b2034d63e513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:48.336265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:48.337263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:48.338537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:48.338537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:48.338537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:48.338537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:48.338537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:48.338537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:48.338537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:48.338537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:48.338537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 473/949] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:48.338537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24cea-4abf-43bb-86d6-b2034d63e513 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.342514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7649ba-0055-4aec-8e2c-d547316b07d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.343149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7649ba-0055-4aec-8e2c-d547316b07d7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.343434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7649ba-0055-4aec-8e2c-d547316b07d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.343749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7649ba-0055-4aec-8e2c-d547316b07d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.344454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7649ba-0055-4aec-8e2c-d547316b07d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:48.344761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7649ba-0055-4aec-8e2c-d547316b07d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.346312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7649ba-0055-4aec-8e2c-d547316b07d7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.354232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:48.373651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 477/950] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:48.373651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7649ba-0055-4aec-8e2c-d547316b07d7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.376158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:48.461204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24cea-4abf-43bb-86d6-b2034d63e513 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.493798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7649ba-0055-4aec-8e2c-d547316b07d7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.497645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d144343-97dc-4459-95d0-887b4678998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.498285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d144343-97dc-4459-95d0-887b4678998c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.498567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d144343-97dc-4459-95d0-887b4678998c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.498843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d144343-97dc-4459-95d0-887b4678998c None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.499488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d144343-97dc-4459-95d0-887b4678998c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:48.499791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d144343-97dc-4459-95d0-887b4678998c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.501182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d144343-97dc-4459-95d0-887b4678998c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.514687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 474/951] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 19 11:59:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:48.514687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f2f52-3fe8-4aa6-be83-0bdafa3242c4 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.514687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f2f52-3fe8-4aa6-be83-0bdafa3242c4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.514687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f2f52-3fe8-4aa6-be83-0bdafa3242c4 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.514687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 475/952] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:48.515756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f2f52-3fe8-4aa6-be83-0bdafa3242c4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.539443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306e0a0-8784-47aa-8919-24665d076041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.540072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e0a0-8784-47aa-8919-24665d076041 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.540353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e0a0-8784-47aa-8919-24665d076041 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.540628 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e0a0-8784-47aa-8919-24665d076041 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.542117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306e0a0-8784-47aa-8919-24665d076041 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:48.542428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306e0a0-8784-47aa-8919-24665d076041 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.543881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306e0a0-8784-47aa-8919-24665d076041 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.556251 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 478/953] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:48.558113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ee5cb-e407-467e-9e56-160b902f48f8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.558434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ee5cb-e407-467e-9e56-160b902f48f8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.558714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ee5cb-e407-467e-9e56-160b902f48f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.579727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-651ee5cb-e407-467e-9e56-160b902f48f8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:48.580906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-651ee5cb-e407-467e-9e56-160b902f48f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:48.604584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:48.644383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f2f52-3fe8-4aa6-be83-0bdafa3242c4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.646134 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:48.657410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 479/954] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:48.658413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ee5cb-e407-467e-9e56-160b902f48f8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.693407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79387c-4b36-4857-bb45-f55319124328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.694784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79387c-4b36-4857-bb45-f55319124328 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.695499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79387c-4b36-4857-bb45-f55319124328 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.695992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79387c-4b36-4857-bb45-f55319124328 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.697531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79387c-4b36-4857-bb45-f55319124328 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:48.698316 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79387c-4b36-4857-bb45-f55319124328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.699899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79387c-4b36-4857-bb45-f55319124328 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.710973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 476/955] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 19 11:59:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:48.711995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79387c-4b36-4857-bb45-f55319124328 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.779178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ee5cb-e407-467e-9e56-160b902f48f8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.825882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05eb4-9853-4970-96d2-a6bf5f6e8ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.826810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05eb4-9853-4970-96d2-a6bf5f6e8ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.827493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05eb4-9853-4970-96d2-a6bf5f6e8ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.828397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05eb4-9853-4970-96d2-a6bf5f6e8ef6 None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/42d7224dbe7944789327082192495039/roles/60dc3e6f759b4f9f9b5bab5fc1be0d0e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.830977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79387c-4b36-4857-bb45-f55319124328 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.831466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb05eb4-9853-4970-96d2-a6bf5f6e8ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=42d7224dbe7944789327082192495039, role_id=60dc3e6f759b4f9f9b5bab5fc1be0d0e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.834148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb05eb4-9853-4970-96d2-a6bf5f6e8ef6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.855317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 480/956] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 11:59:48 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/42d7224dbe7944789327082192495039/roles/60dc3e6f759b4f9f9b5bab5fc1be0d0e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:59:48.875410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d91901-78a2-4f3d-b5bc-059893b45e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.876404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d91901-78a2-4f3d-b5bc-059893b45e31 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.876826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d91901-78a2-4f3d-b5bc-059893b45e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.877251 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d91901-78a2-4f3d-b5bc-059893b45e31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.878125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d91901-78a2-4f3d-b5bc-059893b45e31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.879745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d91901-78a2-4f3d-b5bc-059893b45e31 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.886757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:48.907100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 477/957] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 11:59:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:59:48.936412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05eb4-9853-4970-96d2-a6bf5f6e8ef6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:49.015346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:49.070890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05eb4-9853-4970-96d2-a6bf5f6e8ef6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:49.116038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccb8cc-4d98-4eef-890d-4d06dda609dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:49.116604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccb8cc-4d98-4eef-890d-4d06dda609dc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:49.116882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccb8cc-4d98-4eef-890d-4d06dda609dc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:49.117177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccb8cc-4d98-4eef-890d-4d06dda609dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:49.117785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccb8cc-4d98-4eef-890d-4d06dda609dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:49.119892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccb8cc-4d98-4eef-890d-4d06dda609dc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-a3ccb8cc-4d98-4eef-890d-4d06dda609dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:49.130367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:49.131473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:49.132339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 481/958] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:49.138014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d91901-78a2-4f3d-b5bc-059893b45e31 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:49.251246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d91901-78a2-4f3d-b5bc-059893b45e31 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:49.286941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b67011-6565-448c-9405-193861808acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:49.287922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67011-6565-448c-9405-193861808acc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:49.288416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67011-6565-448c-9405-193861808acc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:49.288880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67011-6565-448c-9405-193861808acc None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:49.289753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b67011-6565-448c-9405-193861808acc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:49.290264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b67011-6565-448c-9405-193861808acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:49.292453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b67011-6565-448c-9405-193861808acc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:49.298012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 478/959] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:49.303473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccb8cc-4d98-4eef-890d-4d06dda609dc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:49.413832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccb8cc-4d98-4eef-890d-4d06dda609dc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:49.436561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:49.448831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06984065-6ec5-4fa6-9317-f5fa089adf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:49.449439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06984065-6ec5-4fa6-9317-f5fa089adf24 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:49.449744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06984065-6ec5-4fa6-9317-f5fa089adf24 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:49.450014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06984065-6ec5-4fa6-9317-f5fa089adf24 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:49.450635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06984065-6ec5-4fa6-9317-f5fa089adf24 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:49.450933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06984065-6ec5-4fa6-9317-f5fa089adf24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:49.452283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06984065-6ec5-4fa6-9317-f5fa089adf24 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:49.457285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 482/960] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:50.655053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fb21-3c48-4683-aebf-8e025b175561 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:50.655578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fb21-3c48-4683-aebf-8e025b175561 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:50.655578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fb21-3c48-4683-aebf-8e025b175561 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:50.657180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 479/961] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:50.662672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497964fb-cd83-43dc-95c7-afebe66e0dca None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:50.664997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497964fb-cd83-43dc-95c7-afebe66e0dca None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:50.665292 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497964fb-cd83-43dc-95c7-afebe66e0dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:50.686752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-497964fb-cd83-43dc-95c7-afebe66e0dca None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:50.687948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-497964fb-cd83-43dc-95c7-afebe66e0dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:50.756706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 483/962] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:51.031101 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42fb21-3c48-4683-aebf-8e025b175561 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:51.095786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:51.105665 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8af7-2248-4df4-92ce-1dd763d3ea88 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.105962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8af7-2248-4df4-92ce-1dd763d3ea88 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.106252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8af7-2248-4df4-92ce-1dd763d3ea88 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.107996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 484/963] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:51.112879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd9b2-eb3b-40a1-9b6f-672fc5bff5d1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.113281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd9b2-eb3b-40a1-9b6f-672fc5bff5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.113565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd9b2-eb3b-40a1-9b6f-672fc5bff5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.133501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a4dcd9b2-eb3b-40a1-9b6f-672fc5bff5d1 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:51.135388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a4dcd9b2-eb3b-40a1-9b6f-672fc5bff5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:51.145651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42fb21-3c48-4683-aebf-8e025b175561 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:51.180267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccc9ec-63f3-497e-a371-e0240f273bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:51.180879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccc9ec-63f3-497e-a371-e0240f273bfa None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.181156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccc9ec-63f3-497e-a371-e0240f273bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.181966 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccc9ec-63f3-497e-a371-e0240f273bfa None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.182629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccc9ec-63f3-497e-a371-e0240f273bfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:51.184044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccc9ec-63f3-497e-a371-e0240f273bfa None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:51.199142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.sql.core [None req-a4ccc9ec-63f3-497e-a371-e0240f273bfa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:59:51.199142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 11:59:51.199142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [parameters: {'user_id': 'b12864ec8f3a42bca69885cef6dada65', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 11:59:51.199142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a4ccc9ec-63f3-497e-a371-e0240f273bfa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Sep 19 11:59:51.207871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:59:51.208788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application yield resource Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise self.value Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application session.commit() Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:59:51.209779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:59:51.210680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:59:51.211595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:59:51.212451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b12864ec8f3a42bca69885cef6dada65', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:51.213869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 19 11:59:51.214664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 19 11:59:51.218064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 19 11:59:51.218064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 19 11:59:51.218064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:59:51.218064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:59:51.218064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 11:59:51.218064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:51.222282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 485/964] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:51.222428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 480/965] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Sep 19 11:59:51 2022] POST /identity/v3/users => generated 160 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:51.222567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f156-efae-4e17-bc9f-22bd2b41014b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.222567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f156-efae-4e17-bc9f-22bd2b41014b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.222567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f156-efae-4e17-bc9f-22bd2b41014b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.223282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccc9ec-63f3-497e-a371-e0240f273bfa None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:51.223423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 486/966] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:51.229461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0c00f-ee92-4ed9-b8a3-69c427295dc7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.229461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0c00f-ee92-4ed9-b8a3-69c427295dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.229461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0c00f-ee92-4ed9-b8a3-69c427295dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.245602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-83a0c00f-ee92-4ed9-b8a3-69c427295dc7 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:51.247119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-83a0c00f-ee92-4ed9-b8a3-69c427295dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:51.278756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:51.329672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 487/967] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:51.356634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccc9ec-63f3-497e-a371-e0240f273bfa None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:51.375298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:51.393402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761114-2e29-43c7-a693-06a6faef445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:51.394083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761114-2e29-43c7-a693-06a6faef445f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.394360 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761114-2e29-43c7-a693-06a6faef445f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.394705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761114-2e29-43c7-a693-06a6faef445f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.404874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81761114-2e29-43c7-a693-06a6faef445f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:51.406539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81761114-2e29-43c7-a693-06a6faef445f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-81761114-2e29-43c7-a693-06a6faef445f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:51.418971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:51.420012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:51.420945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:51.420945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:51.420945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:51.420945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:51.420945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:51.420945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:51.420945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:51.420945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:51.420945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:59:51.420945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:51.424902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 481/968] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 11:59:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:51.426303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0c00f-ee92-4ed9-b8a3-69c427295dc7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:51.487469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761114-2e29-43c7-a693-06a6faef445f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:51.542503 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0c00f-ee92-4ed9-b8a3-69c427295dc7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:51.588439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3860f5e-8466-4cba-b882-5028b7134d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:51.589389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3860f5e-8466-4cba-b882-5028b7134d7c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.589716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3860f5e-8466-4cba-b882-5028b7134d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.589996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3860f5e-8466-4cba-b882-5028b7134d7c None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.590781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3860f5e-8466-4cba-b882-5028b7134d7c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:51.591093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3860f5e-8466-4cba-b882-5028b7134d7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:51.592689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3860f5e-8466-4cba-b882-5028b7134d7c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:51.606877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761114-2e29-43c7-a693-06a6faef445f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:51.631816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 488/969] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 19 11:59:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:51.632560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3860f5e-8466-4cba-b882-5028b7134d7c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:51.647607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104195f-a2b8-43d9-9d73-5a0574381e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:51.648673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104195f-a2b8-43d9-9d73-5a0574381e60 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.649154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104195f-a2b8-43d9-9d73-5a0574381e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.649653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104195f-a2b8-43d9-9d73-5a0574381e60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.662092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104195f-a2b8-43d9-9d73-5a0574381e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c104195f-a2b8-43d9-9d73-5a0574381e60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:59:51.669107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:51.670097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:59:51.670932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:51.673855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 482/970] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 19 11:59:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:51.679816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104195f-a2b8-43d9-9d73-5a0574381e60 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:51.695104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:51.724655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:51.772380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3860f5e-8466-4cba-b882-5028b7134d7c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:51.798698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104195f-a2b8-43d9-9d73-5a0574381e60 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:51.819195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73a136-e021-421a-821c-4eb4d64758d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:51.819842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73a136-e021-421a-821c-4eb4d64758d9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.820117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73a136-e021-421a-821c-4eb4d64758d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.820386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73a136-e021-421a-821c-4eb4d64758d9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.820969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73a136-e021-421a-821c-4eb4d64758d9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:51.822421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73a136-e021-421a-821c-4eb4d64758d9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ef73a136-e021-421a-821c-4eb4d64758d9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:51.831771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:51.832836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:51.839745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 489/971] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:51.840545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1039-29f7-41ba-a8bd-1fe318682c15 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.840545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1039-29f7-41ba-a8bd-1fe318682c15 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.840545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1039-29f7-41ba-a8bd-1fe318682c15 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.841189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 490/972] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:51.842053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1039-29f7-41ba-a8bd-1fe318682c15 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:51.843414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb7531-ebc6-425e-8f52-df6f56fd07ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:51.844205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7531-ebc6-425e-8f52-df6f56fd07ab None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.844484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7531-ebc6-425e-8f52-df6f56fd07ab None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.844758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7531-ebc6-425e-8f52-df6f56fd07ab None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.845425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb7531-ebc6-425e-8f52-df6f56fd07ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:51.845763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb7531-ebc6-425e-8f52-df6f56fd07ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:51.847133 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb7531-ebc6-425e-8f52-df6f56fd07ab None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:51.860376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 483/973] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 19 11:59:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:51.861485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e53a5-95ca-4d29-82a3-e7a2261cb406 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.861867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e53a5-95ca-4d29-82a3-e7a2261cb406 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.862144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e53a5-95ca-4d29-82a3-e7a2261cb406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.882923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-444e53a5-95ca-4d29-82a3-e7a2261cb406 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:51.884454 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-444e53a5-95ca-4d29-82a3-e7a2261cb406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:51.948664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:51.959660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1039-29f7-41ba-a8bd-1fe318682c15 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:51.965694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 484/974] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:51.966534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e53a5-95ca-4d29-82a3-e7a2261cb406 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:51.996447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:52.003812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567f93f-9afe-4c29-8bac-c2330145130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:52.004425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567f93f-9afe-4c29-8bac-c2330145130a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:52.004706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567f93f-9afe-4c29-8bac-c2330145130a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:52.004979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567f93f-9afe-4c29-8bac-c2330145130a None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:52.005602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567f93f-9afe-4c29-8bac-c2330145130a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:52.005975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567f93f-9afe-4c29-8bac-c2330145130a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:52.007359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567f93f-9afe-4c29-8bac-c2330145130a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:52.012447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 491/975] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 19 11:59:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:52.017768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567f93f-9afe-4c29-8bac-c2330145130a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:52.070661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e53a5-95ca-4d29-82a3-e7a2261cb406 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:52.108832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808c3d4-26eb-4d01-a24a-2abd62b7be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:52.109886 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808c3d4-26eb-4d01-a24a-2abd62b7be0e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:52.110167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808c3d4-26eb-4d01-a24a-2abd62b7be0e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:52.110488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808c3d4-26eb-4d01-a24a-2abd62b7be0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:52.121910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808c3d4-26eb-4d01-a24a-2abd62b7be0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:52.123637 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808c3d4-26eb-4d01-a24a-2abd62b7be0e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:52.134051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567f93f-9afe-4c29-8bac-c2330145130a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c808c3d4-26eb-4d01-a24a-2abd62b7be0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:52.139083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:52.139982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:52.141002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:52.141002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:52.141002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:52.141002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 485/976] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:52.145656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808c3d4-26eb-4d01-a24a-2abd62b7be0e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:52.176983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786efd7b-abc3-4fbc-b63d-c51a871c8616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:52.177586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786efd7b-abc3-4fbc-b63d-c51a871c8616 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:52.177911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786efd7b-abc3-4fbc-b63d-c51a871c8616 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:52.178338 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786efd7b-abc3-4fbc-b63d-c51a871c8616 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:52.178794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786efd7b-abc3-4fbc-b63d-c51a871c8616 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:52.179185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786efd7b-abc3-4fbc-b63d-c51a871c8616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:52.180442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786efd7b-abc3-4fbc-b63d-c51a871c8616 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:52.185884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 492/977] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 19 11:59:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:52.197608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786efd7b-abc3-4fbc-b63d-c51a871c8616 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:52.229457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:52.239114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:52.257474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808c3d4-26eb-4d01-a24a-2abd62b7be0e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:52.291532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db02fc-746f-4511-94de-34d0224e090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:52.292131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db02fc-746f-4511-94de-34d0224e090f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:52.292415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db02fc-746f-4511-94de-34d0224e090f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:52.292684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db02fc-746f-4511-94de-34d0224e090f None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:52.293313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db02fc-746f-4511-94de-34d0224e090f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:52.293635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db02fc-746f-4511-94de-34d0224e090f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:52.294994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db02fc-746f-4511-94de-34d0224e090f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:52.306838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 486/978] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:52.307808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db02fc-746f-4511-94de-34d0224e090f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:52.314259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786efd7b-abc3-4fbc-b63d-c51a871c8616 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:52.348512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b9af-d262-4785-afd5-61f5bac307c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:52.349123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b9af-d262-4785-afd5-61f5bac307c4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:52.349399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b9af-d262-4785-afd5-61f5bac307c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:52.349698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b9af-d262-4785-afd5-61f5bac307c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:52.350402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96b9af-d262-4785-afd5-61f5bac307c4 None admin] RBAC: Adding query filter params (interface=admin, service_id=ac4040c97c394f3c8c902a1dcba3fe32, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:52.350711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96b9af-d262-4785-afd5-61f5bac307c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:52.352069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96b9af-d262-4785-afd5-61f5bac307c4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:52.358061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 493/979] 10.222.0.50 () {56 vars in 1249 bytes} [Mon Sep 19 11:59:52 2022] GET /identity/v3/endpoints?service_id=ac4040c97c394f3c8c902a1dcba3fe32&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:52.358905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b9af-d262-4785-afd5-61f5bac307c4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:52.408388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db02fc-746f-4511-94de-34d0224e090f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:52.441402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:52.443651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec04a8-0a7c-45ab-82e6-0913aaa99ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:52.444250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec04a8-0a7c-45ab-82e6-0913aaa99ead None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:52.444524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec04a8-0a7c-45ab-82e6-0913aaa99ead None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:52.444794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec04a8-0a7c-45ab-82e6-0913aaa99ead None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:52.445430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec04a8-0a7c-45ab-82e6-0913aaa99ead None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:52.446805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec04a8-0a7c-45ab-82e6-0913aaa99ead None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:52.459728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b9af-d262-4785-afd5-61f5bac307c4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:52.460557 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 487/980] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:59:52 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:59:52.461340 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec04a8-0a7c-45ab-82e6-0913aaa99ead None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:52.464009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:52.510692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff25ef-94c3-4fd9-bfcc-615b18c745dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:52.511449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff25ef-94c3-4fd9-bfcc-615b18c745dd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:52.511810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff25ef-94c3-4fd9-bfcc-615b18c745dd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:52.512393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff25ef-94c3-4fd9-bfcc-615b18c745dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:52.522330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff25ef-94c3-4fd9-bfcc-615b18c745dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:52.523911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff25ef-94c3-4fd9-bfcc-615b18c745dd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cfff25ef-94c3-4fd9-bfcc-615b18c745dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:59:52.536457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:52.537535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:52.538527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 494/981] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 19 11:59:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:52.545394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff25ef-94c3-4fd9-bfcc-615b18c745dd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:52.583305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec04a8-0a7c-45ab-82e6-0913aaa99ead None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:52.623146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594edaa1-241a-4f53-bf3b-ac9aafe299d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:52.623678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594edaa1-241a-4f53-bf3b-ac9aafe299d0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:52.623967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594edaa1-241a-4f53-bf3b-ac9aafe299d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:52.624219 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594edaa1-241a-4f53-bf3b-ac9aafe299d0 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:52.624829 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594edaa1-241a-4f53-bf3b-ac9aafe299d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:52.626260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594edaa1-241a-4f53-bf3b-ac9aafe299d0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:52.632881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 488/982] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 19 11:59:52 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:59:52.667265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff25ef-94c3-4fd9-bfcc-615b18c745dd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:52.708221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25a523-fee8-46da-ad77-404512b19265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:52.708856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25a523-fee8-46da-ad77-404512b19265 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:52.709125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25a523-fee8-46da-ad77-404512b19265 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:52.709383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25a523-fee8-46da-ad77-404512b19265 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:52.710161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25a523-fee8-46da-ad77-404512b19265 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:52.710461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25a523-fee8-46da-ad77-404512b19265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:52.711914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25a523-fee8-46da-ad77-404512b19265 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:52.722808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:52.735255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 495/983] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 19 11:59:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:52.740843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594edaa1-241a-4f53-bf3b-ac9aafe299d0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:52.813833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:52.855789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594edaa1-241a-4f53-bf3b-ac9aafe299d0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:52.890189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872caa8-7542-4356-85c6-fa9866d8e5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:52.890713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872caa8-7542-4356-85c6-fa9866d8e5ad None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:52.890988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872caa8-7542-4356-85c6-fa9866d8e5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:52.891259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872caa8-7542-4356-85c6-fa9866d8e5ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:52.957840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872caa8-7542-4356-85c6-fa9866d8e5ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:52.959283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872caa8-7542-4356-85c6-fa9866d8e5ad None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:53.022812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:53.060306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 489/984] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 11:59:52 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:59:53.066330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25a523-fee8-46da-ad77-404512b19265 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:53.166598 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25a523-fee8-46da-ad77-404512b19265 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:53.200930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfe152-36d9-45d2-bf75-be466276d1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:53.201564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfe152-36d9-45d2-bf75-be466276d1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:53.201865 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfe152-36d9-45d2-bf75-be466276d1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:53.202138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfe152-36d9-45d2-bf75-be466276d1e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:53.212633 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfe152-36d9-45d2-bf75-be466276d1e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:53.214107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfe152-36d9-45d2-bf75-be466276d1e4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-44bfe152-36d9-45d2-bf75-be466276d1e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:59:53.230249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:53.231226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:59:53.236935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:59:53.236935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:59:53.236935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:53.236935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 496/985] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:53.238719 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872caa8-7542-4356-85c6-fa9866d8e5ad None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:53.338454 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872caa8-7542-4356-85c6-fa9866d8e5ad None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:53.374618 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8ba3f-8539-413a-8792-d8b6bcd9c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:53.375226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ba3f-8539-413a-8792-d8b6bcd9c00b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:53.375503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ba3f-8539-413a-8792-d8b6bcd9c00b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:53.375822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8ba3f-8539-413a-8792-d8b6bcd9c00b None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:53.376468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8ba3f-8539-413a-8792-d8b6bcd9c00b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:53.376769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8ba3f-8539-413a-8792-d8b6bcd9c00b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:53.378169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8ba3f-8539-413a-8792-d8b6bcd9c00b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:53.394380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 490/986] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 11:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:53.396186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfe152-36d9-45d2-bf75-be466276d1e4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:53.447252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:53.499033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfe152-36d9-45d2-bf75-be466276d1e4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:53.531361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34327668-1af8-4d29-9a7b-7558af8e571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:53.531986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34327668-1af8-4d29-9a7b-7558af8e571d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:53.532265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34327668-1af8-4d29-9a7b-7558af8e571d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:53.532535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34327668-1af8-4d29-9a7b-7558af8e571d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:53.539792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34327668-1af8-4d29-9a7b-7558af8e571d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:53.541968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34327668-1af8-4d29-9a7b-7558af8e571d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-34327668-1af8-4d29-9a7b-7558af8e571d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:59:53.554579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:53.555620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:53.561645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:59:53.561645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:59:53.561645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:59:53.561645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:59:53.561645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:59:53.561645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:59:53.561645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:59:53.561645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:53.561645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 497/987] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:53.563567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8ba3f-8539-413a-8792-d8b6bcd9c00b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:53.591712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:53.673395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8ba3f-8539-413a-8792-d8b6bcd9c00b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:53.706507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b941a5-db49-4e6e-8f8d-38b9608a9553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:53.707040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b941a5-db49-4e6e-8f8d-38b9608a9553 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:53.707318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b941a5-db49-4e6e-8f8d-38b9608a9553 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:53.707592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b941a5-db49-4e6e-8f8d-38b9608a9553 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:53.708271 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b941a5-db49-4e6e-8f8d-38b9608a9553 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:53.708575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b941a5-db49-4e6e-8f8d-38b9608a9553 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:53.710015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b941a5-db49-4e6e-8f8d-38b9608a9553 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:53.722611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 491/988] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 11:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:53.728900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34327668-1af8-4d29-9a7b-7558af8e571d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:53.829749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34327668-1af8-4d29-9a7b-7558af8e571d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:53.838495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:53.864983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc61f7-da82-4bdf-9f49-b3f2f7a23c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:53.865521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc61f7-da82-4bdf-9f49-b3f2f7a23c27 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:53.865829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc61f7-da82-4bdf-9f49-b3f2f7a23c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:53.866157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc61f7-da82-4bdf-9f49-b3f2f7a23c27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:53.866876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc61f7-da82-4bdf-9f49-b3f2f7a23c27 None admin] RBAC: Adding query filter params (role.id=60dc3e6f759b4f9f9b5bab5fc1be0d0e, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=42d7224dbe7944789327082192495039) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:53.867183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc61f7-da82-4bdf-9f49-b3f2f7a23c27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:53.868601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc61f7-da82-4bdf-9f49-b3f2f7a23c27 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:53.877747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 498/989] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 11:59:53 2022] GET /identity/v3/role_assignments?user.id=42d7224dbe7944789327082192495039&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=60dc3e6f759b4f9f9b5bab5fc1be0d0e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:54.722825 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd24f4-9f4d-44e9-84fc-8d67e1796163 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:54.723586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd24f4-9f4d-44e9-84fc-8d67e1796163 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:54.723663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd24f4-9f4d-44e9-84fc-8d67e1796163 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:54.725133 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 492/990] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:54.731030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d26718-c76b-4dd5-9050-baadffb43e8f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:54.731539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d26718-c76b-4dd5-9050-baadffb43e8f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:54.731612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d26718-c76b-4dd5-9050-baadffb43e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:54.751523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-83d26718-c76b-4dd5-9050-baadffb43e8f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:54.752737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-83d26718-c76b-4dd5-9050-baadffb43e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:54.825650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 499/991] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:54.857177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370264b-b3be-49b0-8321-4ce64f16b09d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:54.857525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370264b-b3be-49b0-8321-4ce64f16b09d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:54.857807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370264b-b3be-49b0-8321-4ce64f16b09d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:54.859645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 493/992] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:54.865659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c48085-8ee0-4500-a78d-454f33a6c14f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:54.866049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c48085-8ee0-4500-a78d-454f33a6c14f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:54.866459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c48085-8ee0-4500-a78d-454f33a6c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:54.886772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e5c48085-8ee0-4500-a78d-454f33a6c14f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:54.887946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e5c48085-8ee0-4500-a78d-454f33a6c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:54.954643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 500/993] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:55.095937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370264b-b3be-49b0-8321-4ce64f16b09d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:55.184892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:55.201902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370264b-b3be-49b0-8321-4ce64f16b09d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:55.227737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c48085-8ee0-4500-a78d-454f33a6c14f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:55.235678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845afa37-c167-4359-9f37-b9509d20842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:55.236314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845afa37-c167-4359-9f37-b9509d20842f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:55.236595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845afa37-c167-4359-9f37-b9509d20842f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:55.236867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845afa37-c167-4359-9f37-b9509d20842f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:55.237446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845afa37-c167-4359-9f37-b9509d20842f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:55.238830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845afa37-c167-4359-9f37-b9509d20842f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-845afa37-c167-4359-9f37-b9509d20842f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:55.248447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:55.249406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:55.250877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 494/994] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:55.255525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845afa37-c167-4359-9f37-b9509d20842f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:55.263575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:55.334536 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c48085-8ee0-4500-a78d-454f33a6c14f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:55.358642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845afa37-c167-4359-9f37-b9509d20842f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:55.370611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5a4a-43de-4f01-a2cd-5d193812e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:55.371246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5a4a-43de-4f01-a2cd-5d193812e982 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:55.371529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5a4a-43de-4f01-a2cd-5d193812e982 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:55.371803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5a4a-43de-4f01-a2cd-5d193812e982 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:55.372379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f5a4a-43de-4f01-a2cd-5d193812e982 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:55.373842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f5a4a-43de-4f01-a2cd-5d193812e982 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1c1f5a4a-43de-4f01-a2cd-5d193812e982 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:55.382549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:55.383542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 11:59:55.385088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 501/995] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 19 11:59:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:59:55.390085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5a4a-43de-4f01-a2cd-5d193812e982 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:55.397076 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483a8d7-8935-4297-aade-64d924be4b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:55.397723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483a8d7-8935-4297-aade-64d924be4b07 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:55.398009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483a8d7-8935-4297-aade-64d924be4b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:55.398283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483a8d7-8935-4297-aade-64d924be4b07 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:55.398938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483a8d7-8935-4297-aade-64d924be4b07 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:55.399247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483a8d7-8935-4297-aade-64d924be4b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:55.400714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483a8d7-8935-4297-aade-64d924be4b07 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:55.405995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 495/996] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:55.411139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483a8d7-8935-4297-aade-64d924be4b07 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:55.428125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:55.502604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:55.509899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5a4a-43de-4f01-a2cd-5d193812e982 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:55.518953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483a8d7-8935-4297-aade-64d924be4b07 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:55.545791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f834bf3-a33e-4907-900b-4a593fdf5075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:55.546628 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f834bf3-a33e-4907-900b-4a593fdf5075 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:55.547055 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f834bf3-a33e-4907-900b-4a593fdf5075 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:55.547485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f834bf3-a33e-4907-900b-4a593fdf5075 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:55.548249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f834bf3-a33e-4907-900b-4a593fdf5075 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:55.548695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f834bf3-a33e-4907-900b-4a593fdf5075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:55.550229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f834bf3-a33e-4907-900b-4a593fdf5075 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:55.553802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7476bfd-d3a7-4b56-943f-f25db61e4418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:55.554410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476bfd-d3a7-4b56-943f-f25db61e4418 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:55.554693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476bfd-d3a7-4b56-943f-f25db61e4418 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:55.554968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476bfd-d3a7-4b56-943f-f25db61e4418 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:55.555594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7476bfd-d3a7-4b56-943f-f25db61e4418 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:55.555899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7476bfd-d3a7-4b56-943f-f25db61e4418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:55.557553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 502/997] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 19 11:59:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:55.558130 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7476bfd-d3a7-4b56-943f-f25db61e4418 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:55.562766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f834bf3-a33e-4907-900b-4a593fdf5075 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:55.565803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 496/998] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:55.571562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7476bfd-d3a7-4b56-943f-f25db61e4418 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:55.654865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:55.678384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7476bfd-d3a7-4b56-943f-f25db61e4418 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:55.683144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f834bf3-a33e-4907-900b-4a593fdf5075 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:55.716482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d671-be8e-4292-aa38-54fa642d0d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:55.717468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d671-be8e-4292-aa38-54fa642d0d15 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:55.717794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d671-be8e-4292-aa38-54fa642d0d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:55.718066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d671-be8e-4292-aa38-54fa642d0d15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:55.718645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375fe32-b30e-45d4-b9a2-87a2fc65e3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:55.718760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5d671-be8e-4292-aa38-54fa642d0d15 None admin] RBAC: Adding query filter params (interface=public, service_id=c95396bfdfd449edb89697f42da22e47, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:55.719061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5d671-be8e-4292-aa38-54fa642d0d15 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:55.719249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375fe32-b30e-45d4-b9a2-87a2fc65e3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:55.719525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375fe32-b30e-45d4-b9a2-87a2fc65e3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:55.719792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375fe32-b30e-45d4-b9a2-87a2fc65e3c7 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:55.720411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375fe32-b30e-45d4-b9a2-87a2fc65e3c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:55.720513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5d671-be8e-4292-aa38-54fa642d0d15 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:55.720709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375fe32-b30e-45d4-b9a2-87a2fc65e3c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:55.722095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375fe32-b30e-45d4-b9a2-87a2fc65e3c7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:55.731295 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 497/999] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 19 11:59:55 2022] GET /identity/v3/endpoints?service_id=c95396bfdfd449edb89697f42da22e47&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:55.731801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 503/1000] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 19 11:59:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:55.732536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d671-be8e-4292-aa38-54fa642d0d15 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:55.734086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375fe32-b30e-45d4-b9a2-87a2fc65e3c7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:55.760685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:55.836797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d671-be8e-4292-aa38-54fa642d0d15 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:55.845118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375fe32-b30e-45d4-b9a2-87a2fc65e3c7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:55.873085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739dd432-c3d2-4c26-9934-f72f1bc3cdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:55.873976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dd432-c3d2-4c26-9934-f72f1bc3cdfc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:55.874402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dd432-c3d2-4c26-9934-f72f1bc3cdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:55.874824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dd432-c3d2-4c26-9934-f72f1bc3cdfc None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:55.875580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dd432-c3d2-4c26-9934-f72f1bc3cdfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:55.876940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dd432-c3d2-4c26-9934-f72f1bc3cdfc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:55.881289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e09a30-a3a9-42e7-ac13-1da9575fa0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:55.881926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09a30-a3a9-42e7-ac13-1da9575fa0c3 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:55.882206 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09a30-a3a9-42e7-ac13-1da9575fa0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:55.882479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09a30-a3a9-42e7-ac13-1da9575fa0c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:55.883165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e09a30-a3a9-42e7-ac13-1da9575fa0c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:55.883690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 498/1001] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 19 11:59:55 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:59:55.884692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e09a30-a3a9-42e7-ac13-1da9575fa0c3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:55.904513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 504/1002] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 11:59:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:59:56.084945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a0052-cb94-46ec-b816-62fe155967cb None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:56.085235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a0052-cb94-46ec-b816-62fe155967cb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:56.085499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a0052-cb94-46ec-b816-62fe155967cb None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:56.086944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 499/1003] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:56.093180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f365-8527-41e8-a0bf-7ba955206e72 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:56.093465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f365-8527-41e8-a0bf-7ba955206e72 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:56.093772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f365-8527-41e8-a0bf-7ba955206e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:56.112457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7f14f365-8527-41e8-a0bf-7ba955206e72 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:56.113647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7f14f365-8527-41e8-a0bf-7ba955206e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:56.186337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 505/1004] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:56.450707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a0052-cb94-46ec-b816-62fe155967cb None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:56.459883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:56.552483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a0052-cb94-46ec-b816-62fe155967cb None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:56.586525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169b9a-04fe-499e-8e05-e9e08565a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:56.587148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169b9a-04fe-499e-8e05-e9e08565a19d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:56.587423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169b9a-04fe-499e-8e05-e9e08565a19d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:56.587860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169b9a-04fe-499e-8e05-e9e08565a19d None admin] PATH_INFO: `/v3/services/image` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:56.588697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b169b9a-04fe-499e-8e05-e9e08565a19d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:56.590114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b169b9a-04fe-499e-8e05-e9e08565a19d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1b169b9a-04fe-499e-8e05-e9e08565a19d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:56.599308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:56.600347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:59:56.601187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:56.608491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 500/1005] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Sep 19 11:59:56 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:56.608656 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14f365-8527-41e8-a0bf-7ba955206e72 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:56.618492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:56.714678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14f365-8527-41e8-a0bf-7ba955206e72 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:56.750003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1560d6-9cac-469e-817e-fbe44737b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:56.750748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1560d6-9cac-469e-817e-fbe44737b910 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:56.750990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1560d6-9cac-469e-817e-fbe44737b910 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:56.751317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1560d6-9cac-469e-817e-fbe44737b910 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:56.751950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1560d6-9cac-469e-817e-fbe44737b910 None admin] RBAC: Adding query filter params (name=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:56.752257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1560d6-9cac-469e-817e-fbe44737b910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:56.753642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1560d6-9cac-469e-817e-fbe44737b910 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:56.763541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 506/1006] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:56.764768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169b9a-04fe-499e-8e05-e9e08565a19d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:56.837603 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:56.872544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169b9a-04fe-499e-8e05-e9e08565a19d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:56.907137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a5ca7-a7ec-4c3c-a564-503ffccea149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:56.907737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a5ca7-a7ec-4c3c-a564-503ffccea149 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:56.908074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a5ca7-a7ec-4c3c-a564-503ffccea149 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:56.908354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a5ca7-a7ec-4c3c-a564-503ffccea149 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:56.908971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a5ca7-a7ec-4c3c-a564-503ffccea149 None admin] RBAC: Adding query filter params (type=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:56.909274 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a5ca7-a7ec-4c3c-a564-503ffccea149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:56.910665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a5ca7-a7ec-4c3c-a564-503ffccea149 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:56.921665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 501/1007] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:59:58.080139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ad09e-6cfb-4931-a9e1-bddc74c3a88b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:58.080653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ad09e-6cfb-4931-a9e1-bddc74c3a88b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:58.080730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ad09e-6cfb-4931-a9e1-bddc74c3a88b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:58.082175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 507/1008] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:58.087132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37d61-6ef6-43f3-ac37-456f0903c9ff None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:58.088028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37d61-6ef6-43f3-ac37-456f0903c9ff None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:58.088309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37d61-6ef6-43f3-ac37-456f0903c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:58.106620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a4d37d61-6ef6-43f3-ac37-456f0903c9ff None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:58.107813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a4d37d61-6ef6-43f3-ac37-456f0903c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:58.146920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4ea18-51f5-43b1-8438-2d66c4f6b19c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:58.147228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4ea18-51f5-43b1-8438-2d66c4f6b19c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:58.147473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4ea18-51f5-43b1-8438-2d66c4f6b19c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:58.148782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 508/1009] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:59:58.154018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e09540-d3ea-4bcd-919f-d011e34526b1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:58.154372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e09540-d3ea-4bcd-919f-d011e34526b1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:58.154849 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e09540-d3ea-4bcd-919f-d011e34526b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:58.172637 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f9e09540-d3ea-4bcd-919f-d011e34526b1 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:58.174070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f9e09540-d3ea-4bcd-919f-d011e34526b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:58.178122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 502/1010] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:58.240366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 509/1011] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:59:58.452237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37d61-6ef6-43f3-ac37-456f0903c9ff None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:58.513878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:58.516310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e09540-d3ea-4bcd-919f-d011e34526b1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:58.519844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:58.559480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37d61-6ef6-43f3-ac37-456f0903c9ff None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:58.595149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef59358-71c4-411c-9f79-b790e4b8c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:58.595781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef59358-71c4-411c-9f79-b790e4b8c215 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:58.596057 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef59358-71c4-411c-9f79-b790e4b8c215 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:58.596326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef59358-71c4-411c-9f79-b790e4b8c215 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:58.596904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef59358-71c4-411c-9f79-b790e4b8c215 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:58.598542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef59358-71c4-411c-9f79-b790e4b8c215 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-eef59358-71c4-411c-9f79-b790e4b8c215 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:59:58.608002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:59:58.608983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 11:59:58.610450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 503/1012] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 11:59:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:59:58.614792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef59358-71c4-411c-9f79-b790e4b8c215 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:58.630230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e09540-d3ea-4bcd-919f-d011e34526b1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:58.672745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0653-19b4-4968-ae9c-ec28bc7f65a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:58.673185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0653-19b4-4968-ae9c-ec28bc7f65a5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:58.673473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0653-19b4-4968-ae9c-ec28bc7f65a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:58.673768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0653-19b4-4968-ae9c-ec28bc7f65a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:58.675333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b0653-19b4-4968-ae9c-ec28bc7f65a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:58.677241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b0653-19b4-4968-ae9c-ec28bc7f65a5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:58.682036 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 510/1013] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 11:59:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:58.685333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0653-19b4-4968-ae9c-ec28bc7f65a5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:58.721960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef59358-71c4-411c-9f79-b790e4b8c215 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:58.751220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:58.762293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:58.764684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c53c-7b65-4ce2-a64f-a9f62018f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:58.765343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c53c-7b65-4ce2-a64f-a9f62018f71a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:58.765859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c53c-7b65-4ce2-a64f-a9f62018f71a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:58.766140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c53c-7b65-4ce2-a64f-a9f62018f71a None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:58.767205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01c53c-7b65-4ce2-a64f-a9f62018f71a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:58.767517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01c53c-7b65-4ce2-a64f-a9f62018f71a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:58.769247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01c53c-7b65-4ce2-a64f-a9f62018f71a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:58.775921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 504/1014] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:58.781460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c53c-7b65-4ce2-a64f-a9f62018f71a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:58.793705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0653-19b4-4968-ae9c-ec28bc7f65a5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:58.830411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034bd74-d761-4682-8427-8f4666e9cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:58.831014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034bd74-d761-4682-8427-8f4666e9cdeb None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:58.831289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034bd74-d761-4682-8427-8f4666e9cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:58.831558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034bd74-d761-4682-8427-8f4666e9cdeb None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:58.832189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034bd74-d761-4682-8427-8f4666e9cdeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:58.833602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034bd74-d761-4682-8427-8f4666e9cdeb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:58.862376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 511/1015] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:59:58 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:59:58.904501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c53c-7b65-4ce2-a64f-a9f62018f71a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:58.944330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba44bc8-612c-43c5-b24b-77846bdf7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:58.944970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44bc8-612c-43c5-b24b-77846bdf7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:58.945258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44bc8-612c-43c5-b24b-77846bdf7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:58.945533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44bc8-612c-43c5-b24b-77846bdf7bc5 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:58.946238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba44bc8-612c-43c5-b24b-77846bdf7bc5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:59:58.946539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba44bc8-612c-43c5-b24b-77846bdf7bc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:58.948436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba44bc8-612c-43c5-b24b-77846bdf7bc5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:58.954536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 505/1016] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 19 11:59:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:59:58.960690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034bd74-d761-4682-8427-8f4666e9cdeb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:59.061860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6c5f6-5dab-4680-8396-9477c2419e34 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:59.062209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6c5f6-5dab-4680-8396-9477c2419e34 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:59.062417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6c5f6-5dab-4680-8396-9477c2419e34 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:59.063749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 506/1017] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 11:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:59.068925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4f6e4-bf9a-4455-ba76-ec21d2b0fa74 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:59.069204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4f6e4-bf9a-4455-ba76-ec21d2b0fa74 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:59.069473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4f6e4-bf9a-4455-ba76-ec21d2b0fa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:59.084123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034bd74-d761-4682-8427-8f4666e9cdeb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:59.090437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1ce4f6e4-bf9a-4455-ba76-ec21d2b0fa74 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:59.092139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1ce4f6e4-bf9a-4455-ba76-ec21d2b0fa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:59.110755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:59.123443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9cbdf-6363-446d-a1d2-0ea44a4cf765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:59.124050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9cbdf-6363-446d-a1d2-0ea44a4cf765 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:59.124423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9cbdf-6363-446d-a1d2-0ea44a4cf765 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:59.124703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9cbdf-6363-446d-a1d2-0ea44a4cf765 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:59.125489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9cbdf-6363-446d-a1d2-0ea44a4cf765 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:59.126884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9cbdf-6363-446d-a1d2-0ea44a4cf765 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:59.147595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:59.151433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 512/1018] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 11:59:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:59:59.175989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 507/1019] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 11:59:59 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:59:59.449031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9cbdf-6363-446d-a1d2-0ea44a4cf765 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:59.548334 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9cbdf-6363-446d-a1d2-0ea44a4cf765 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:59.582085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a599493-e29d-4fb1-8aa9-674d3c1a8a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:59.582689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a599493-e29d-4fb1-8aa9-674d3c1a8a6f None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:59.583019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a599493-e29d-4fb1-8aa9-674d3c1a8a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:59.583294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a599493-e29d-4fb1-8aa9-674d3c1a8a6f None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:59.583935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a599493-e29d-4fb1-8aa9-674d3c1a8a6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:59.585287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a599493-e29d-4fb1-8aa9-674d3c1a8a6f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:59.601809 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 513/1020] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 11:59:59 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:00:01.106266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3fc9a-7aa4-4356-802c-77ce7145140b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:01.106811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3fc9a-7aa4-4356-802c-77ce7145140b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:01.106811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3fc9a-7aa4-4356-802c-77ce7145140b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:01.108290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 508/1021] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:01.113570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4052-4f45-48a3-b96e-55542fdff783 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:01.114004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4052-4f45-48a3-b96e-55542fdff783 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:01.114186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4052-4f45-48a3-b96e-55542fdff783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:01.132884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f03f4052-4f45-48a3-b96e-55542fdff783 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:01.134097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f03f4052-4f45-48a3-b96e-55542fdff783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:01.170491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:01.210133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 514/1022] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:00:01.418883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f18633-12a8-4532-9de0-dad36e8b6a2b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:01.419085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f18633-12a8-4532-9de0-dad36e8b6a2b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:01.419559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f18633-12a8-4532-9de0-dad36e8b6a2b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:01.421035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 509/1023] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:01.426036 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb447-faec-44f6-a66f-e525d0c4c4b3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:01.426327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb447-faec-44f6-a66f-e525d0c4c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:01.426602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb447-faec-44f6-a66f-e525d0c4c4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:01.445106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-68dbb447-faec-44f6-a66f-e525d0c4c4b3 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:01.446305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-68dbb447-faec-44f6-a66f-e525d0c4c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:01.487054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f18633-12a8-4532-9de0-dad36e8b6a2b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:01.517267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 515/1024] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:01.590357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f18633-12a8-4532-9de0-dad36e8b6a2b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:01.624853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab193fc-b184-4cbe-8235-adbdea080656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:01.625843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab193fc-b184-4cbe-8235-adbdea080656 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:01.626328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab193fc-b184-4cbe-8235-adbdea080656 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:01.626773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab193fc-b184-4cbe-8235-adbdea080656 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:01.628035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab193fc-b184-4cbe-8235-adbdea080656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:01.629779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab193fc-b184-4cbe-8235-adbdea080656 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:01.631792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 510/1025] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:01.637517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbb447-faec-44f6-a66f-e525d0c4c4b3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:01.742278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:01.749578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbb447-faec-44f6-a66f-e525d0c4c4b3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:01.769761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4534aa-d2e0-446b-8ea0-2f048f147118 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:01.770048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4534aa-d2e0-446b-8ea0-2f048f147118 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:01.770316 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4534aa-d2e0-446b-8ea0-2f048f147118 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:01.771887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 511/1026] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 12:00:01.777435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd631e6-86ff-4a37-99aa-d1e313fc918a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:01.777840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd631e6-86ff-4a37-99aa-d1e313fc918a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:01.778293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd631e6-86ff-4a37-99aa-d1e313fc918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:01.786489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70060a5-bcd1-4284-a02c-c4634d1b52ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:01.787092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70060a5-bcd1-4284-a02c-c4634d1b52ff None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:01.787366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70060a5-bcd1-4284-a02c-c4634d1b52ff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:01.787659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70060a5-bcd1-4284-a02c-c4634d1b52ff None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:01.788314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70060a5-bcd1-4284-a02c-c4634d1b52ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:01.789789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70060a5-bcd1-4284-a02c-c4634d1b52ff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:01.796348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5bd631e6-86ff-4a37-99aa-d1e313fc918a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:01.797549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5bd631e6-86ff-4a37-99aa-d1e313fc918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:01.824595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 516/1027] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 12:00:01 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:00:01.824595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70060a5-bcd1-4284-a02c-c4634d1b52ff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:01.865384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:01.891785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 512/1028] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:01.926098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70060a5-bcd1-4284-a02c-c4634d1b52ff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:01.963151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f088ae-9f87-47e3-bae4-f743fb6493ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:01.963800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f088ae-9f87-47e3-bae4-f743fb6493ba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:01.964075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f088ae-9f87-47e3-bae4-f743fb6493ba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:01.964343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f088ae-9f87-47e3-bae4-f743fb6493ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:01.976444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f088ae-9f87-47e3-bae4-f743fb6493ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-52f088ae-9f87-47e3-bae4-f743fb6493ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:01.981844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:01.982746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:01.986717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 517/1029] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 19 12:00:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:01.989385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd631e6-86ff-4a37-99aa-d1e313fc918a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.096066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd631e6-86ff-4a37-99aa-d1e313fc918a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:02.131687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4931cf7-8fed-4083-839d-109fd33da125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:02.132322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4931cf7-8fed-4083-839d-109fd33da125 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:02.132554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4931cf7-8fed-4083-839d-109fd33da125 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:02.132827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4931cf7-8fed-4083-839d-109fd33da125 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:02.133487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4931cf7-8fed-4083-839d-109fd33da125 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:02.133816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4931cf7-8fed-4083-839d-109fd33da125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:02.135316 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4931cf7-8fed-4083-839d-109fd33da125 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:02.143545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 513/1030] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 19 12:00:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:02.149444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f088ae-9f87-47e3-bae4-f743fb6493ba None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.164431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4931cf7-8fed-4083-839d-109fd33da125 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.165128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:02.210879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:02.260429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f088ae-9f87-47e3-bae4-f743fb6493ba None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:02.270817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4931cf7-8fed-4083-839d-109fd33da125 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:02.296617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1762a-386c-44a1-a486-4dd1b2b107c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:02.297354 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1762a-386c-44a1-a486-4dd1b2b107c8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:02.297648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1762a-386c-44a1-a486-4dd1b2b107c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:02.297941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1762a-386c-44a1-a486-4dd1b2b107c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:02.304491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6f505-b0a0-4241-8695-686558e75c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:02.305123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f505-b0a0-4241-8695-686558e75c40 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:02.305391 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f505-b0a0-4241-8695-686558e75c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:02.305682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f505-b0a0-4241-8695-686558e75c40 None admin] PATH_INFO: `/v3/services/image` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:02.306914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6f505-b0a0-4241-8695-686558e75c40 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:02.308373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6f505-b0a0-4241-8695-686558e75c40 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:02.310336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1762a-386c-44a1-a486-4dd1b2b107c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:02.312076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1762a-386c-44a1-a486-4dd1b2b107c8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-dcc6f505-b0a0-4241-8695-686558e75c40 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:02.317010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:02.321841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:02.322849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 514/1031] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Sep 19 12:00:02 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 12:00:02.324597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6f505-b0a0-4241-8695-686558e75c40 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-68a1762a-386c-44a1-a486-4dd1b2b107c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:00:02.327868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:02.328789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:00:02.329767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:00:02.329767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:02.329767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:02.329767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 518/1032] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:02.335601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1762a-386c-44a1-a486-4dd1b2b107c8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.401940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:02.440571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6f505-b0a0-4241-8695-686558e75c40 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:02.440773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1762a-386c-44a1-a486-4dd1b2b107c8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:02.447676 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:02.479136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8da911-6ede-4274-a162-ce23bf76ee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:02.479881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1634b-5f57-4636-afbe-f2b5f99ca557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:02.480040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8da911-6ede-4274-a162-ce23bf76ee25 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:02.480267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8da911-6ede-4274-a162-ce23bf76ee25 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:02.480511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1634b-5f57-4636-afbe-f2b5f99ca557 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:02.480608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8da911-6ede-4274-a162-ce23bf76ee25 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:02.481009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1634b-5f57-4636-afbe-f2b5f99ca557 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:02.481164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8da911-6ede-4274-a162-ce23bf76ee25 None admin] RBAC: Adding query filter params (name=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:02.481336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1634b-5f57-4636-afbe-f2b5f99ca557 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:02.481484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8da911-6ede-4274-a162-ce23bf76ee25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:02.482011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1634b-5f57-4636-afbe-f2b5f99ca557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:02.482317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1634b-5f57-4636-afbe-f2b5f99ca557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:02.482845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8da911-6ede-4274-a162-ce23bf76ee25 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:02.483711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1634b-5f57-4636-afbe-f2b5f99ca557 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:02.488032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 515/1033] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:02.493742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8da911-6ede-4274-a162-ce23bf76ee25 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.502236 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 519/1034] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:02.507812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1634b-5f57-4636-afbe-f2b5f99ca557 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.593751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8da911-6ede-4274-a162-ce23bf76ee25 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:02.613925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1634b-5f57-4636-afbe-f2b5f99ca557 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:02.629165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9b4c0-6762-4149-94c8-6e828e0ece09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:02.629810 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9b4c0-6762-4149-94c8-6e828e0ece09 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:02.630093 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9b4c0-6762-4149-94c8-6e828e0ece09 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:02.630368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9b4c0-6762-4149-94c8-6e828e0ece09 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:02.631091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9b4c0-6762-4149-94c8-6e828e0ece09 None admin] RBAC: Adding query filter params (type=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:02.631401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9b4c0-6762-4149-94c8-6e828e0ece09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:02.632774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9b4c0-6762-4149-94c8-6e828e0ece09 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:02.638198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 516/1035] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:02.644094 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9b4c0-6762-4149-94c8-6e828e0ece09 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.647421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:02.660479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05b643-3134-45cb-9d13-66ff352d7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:02.661115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05b643-3134-45cb-9d13-66ff352d7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:02.661397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05b643-3134-45cb-9d13-66ff352d7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:02.661694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05b643-3134-45cb-9d13-66ff352d7ea6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:02.671837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05b643-3134-45cb-9d13-66ff352d7ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:02.673442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05b643-3134-45cb-9d13-66ff352d7ea6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:02.683229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6e05b643-3134-45cb-9d13-66ff352d7ea6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 12:00:02.686176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:02.687112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:02.688143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 520/1036] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 19 12:00:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 12:00:02.693138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05b643-3134-45cb-9d13-66ff352d7ea6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.761673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9b4c0-6762-4149-94c8-6e828e0ece09 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:02.798341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caad616-e3b2-46cf-8025-33dd5aed1c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:02.798946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caad616-e3b2-46cf-8025-33dd5aed1c90 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:02.799231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caad616-e3b2-46cf-8025-33dd5aed1c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:02.799498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caad616-e3b2-46cf-8025-33dd5aed1c90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:02.800190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caad616-e3b2-46cf-8025-33dd5aed1c90 None admin] RBAC: Adding query filter params (interface=public, service_id=2dff4bf83e3441a0bd945d99ba211755, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:02.800499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caad616-e3b2-46cf-8025-33dd5aed1c90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:02.801887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caad616-e3b2-46cf-8025-33dd5aed1c90 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:02.806505 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05b643-3134-45cb-9d13-66ff352d7ea6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:02.807441 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 517/1037] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 19 12:00:02 2022] GET /identity/v3/endpoints?service_id=2dff4bf83e3441a0bd945d99ba211755&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:02.812956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caad616-e3b2-46cf-8025-33dd5aed1c90 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.842090 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad112-011a-4a28-8501-42472eb7ab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:02.842702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad112-011a-4a28-8501-42472eb7ab5c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:02.842981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad112-011a-4a28-8501-42472eb7ab5c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:02.843254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad112-011a-4a28-8501-42472eb7ab5c None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:02.843971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad112-011a-4a28-8501-42472eb7ab5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:02.844279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad112-011a-4a28-8501-42472eb7ab5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:02.845701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad112-011a-4a28-8501-42472eb7ab5c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:02.865104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 521/1038] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 19 12:00:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:02.871328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad112-011a-4a28-8501-42472eb7ab5c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:02.916299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:02.917422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:02.920363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caad616-e3b2-46cf-8025-33dd5aed1c90 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:02.955872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a315a-399a-4b1e-a38e-45dea6ed96ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:02.956472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a315a-399a-4b1e-a38e-45dea6ed96ce None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:02.956752 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a315a-399a-4b1e-a38e-45dea6ed96ce None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:02.957023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a315a-399a-4b1e-a38e-45dea6ed96ce None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:02.957608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a315a-399a-4b1e-a38e-45dea6ed96ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:02.959005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a315a-399a-4b1e-a38e-45dea6ed96ce None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:02.966588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 518/1039] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 19 12:00:02 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:00:02.986726 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad112-011a-4a28-8501-42472eb7ab5c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:03.025571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc537411-c3a5-4e1c-a8f7-1d354884b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:03.026150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc537411-c3a5-4e1c-a8f7-1d354884b99e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:03.026434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc537411-c3a5-4e1c-a8f7-1d354884b99e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:03.026707 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc537411-c3a5-4e1c-a8f7-1d354884b99e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:03.100978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc537411-c3a5-4e1c-a8f7-1d354884b99e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:03.102477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc537411-c3a5-4e1c-a8f7-1d354884b99e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:03.149300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:03.210197 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 522/1040] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 12:00:03.216722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a315a-399a-4b1e-a38e-45dea6ed96ce None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:03.316578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a315a-399a-4b1e-a38e-45dea6ed96ce None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:03.350771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc967e39-f381-4dc2-b565-0dd4111d39a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:03.351394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967e39-f381-4dc2-b565-0dd4111d39a8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:03.351671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967e39-f381-4dc2-b565-0dd4111d39a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:03.351942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967e39-f381-4dc2-b565-0dd4111d39a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:03.362319 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc967e39-f381-4dc2-b565-0dd4111d39a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:03.363763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc967e39-f381-4dc2-b565-0dd4111d39a8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-cc967e39-f381-4dc2-b565-0dd4111d39a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:00:03.378137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:03.379085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:00:03.379979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:00:03.379979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:03.379979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:03.379979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 519/1041] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:03.386070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc537411-c3a5-4e1c-a8f7-1d354884b99e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:03.484552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc537411-c3a5-4e1c-a8f7-1d354884b99e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:03.517612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f00f2-9447-44ff-b548-0eaca3d07568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:03.518246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f00f2-9447-44ff-b548-0eaca3d07568 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:03.518524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f00f2-9447-44ff-b548-0eaca3d07568 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:03.518792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f00f2-9447-44ff-b548-0eaca3d07568 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:03.519417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f00f2-9447-44ff-b548-0eaca3d07568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:03.519717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f00f2-9447-44ff-b548-0eaca3d07568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:03.521063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f00f2-9447-44ff-b548-0eaca3d07568 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:03.536705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 523/1042] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:03.537978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc967e39-f381-4dc2-b565-0dd4111d39a8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:03.555641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:03.642239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc967e39-f381-4dc2-b565-0dd4111d39a8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:03.683758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266087d-d526-477c-8582-a1a4583fed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:03.684564 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266087d-d526-477c-8582-a1a4583fed05 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:03.684933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266087d-d526-477c-8582-a1a4583fed05 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:03.685299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266087d-d526-477c-8582-a1a4583fed05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:03.692372 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266087d-d526-477c-8582-a1a4583fed05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:03.693954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266087d-d526-477c-8582-a1a4583fed05 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a266087d-d526-477c-8582-a1a4583fed05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 12:00:03.705989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:03.707058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:03.708163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 12:00:03.708163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 12:00:03.708163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 12:00:03.708163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 12:00:03.708163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 12:00:03.708163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 12:00:03.708163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:00:03.708163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:03.709650 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 520/1043] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 12:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 12:00:03.715303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f00f2-9447-44ff-b548-0eaca3d07568 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:03.718198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:03.816427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f00f2-9447-44ff-b548-0eaca3d07568 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:03.851689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74fc18-ad66-4cf9-86c1-e6a8faebf412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:03.852314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74fc18-ad66-4cf9-86c1-e6a8faebf412 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:03.852590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74fc18-ad66-4cf9-86c1-e6a8faebf412 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:03.852859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74fc18-ad66-4cf9-86c1-e6a8faebf412 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:03.854120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74fc18-ad66-4cf9-86c1-e6a8faebf412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:03.854420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74fc18-ad66-4cf9-86c1-e6a8faebf412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:03.855849 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74fc18-ad66-4cf9-86c1-e6a8faebf412 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:03.868351 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 524/1044] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 12:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:03.874791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266087d-d526-477c-8582-a1a4583fed05 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:03.953495 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:03.982407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266087d-d526-477c-8582-a1a4583fed05 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:04.018833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c125de1-a5b6-4bc3-8163-8420beeef7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:04.019434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c125de1-a5b6-4bc3-8163-8420beeef7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:04.019715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c125de1-a5b6-4bc3-8163-8420beeef7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:04.019988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c125de1-a5b6-4bc3-8163-8420beeef7b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:04.020704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c125de1-a5b6-4bc3-8163-8420beeef7b8 None admin] RBAC: Adding query filter params (role.id=60dc3e6f759b4f9f9b5bab5fc1be0d0e, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=02430b0097f94fa0a2015480a6ec68eb) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:04.021014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c125de1-a5b6-4bc3-8163-8420beeef7b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:04.022472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c125de1-a5b6-4bc3-8163-8420beeef7b8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:04.033665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 521/1045] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:00:03 2022] GET /identity/v3/role_assignments?user.id=02430b0097f94fa0a2015480a6ec68eb&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=60dc3e6f759b4f9f9b5bab5fc1be0d0e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:04.068973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4994a-02e2-40ec-b4ab-fa19cbe3dc68 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:04.069248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4994a-02e2-40ec-b4ab-fa19cbe3dc68 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:04.069527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4994a-02e2-40ec-b4ab-fa19cbe3dc68 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:04.071055 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 525/1046] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 12:00:04.076829 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1eaa56-f0ae-4fbd-81f0-b20c1f1bda98 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:04.077113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1eaa56-f0ae-4fbd-81f0-b20c1f1bda98 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:04.077396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1eaa56-f0ae-4fbd-81f0-b20c1f1bda98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:04.097206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ac1eaa56-f0ae-4fbd-81f0-b20c1f1bda98 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:04.098711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ac1eaa56-f0ae-4fbd-81f0-b20c1f1bda98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:04.173804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 522/1047] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:04.441546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4994a-02e2-40ec-b4ab-fa19cbe3dc68 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:04.506198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:04.546951 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4994a-02e2-40ec-b4ab-fa19cbe3dc68 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:04.580673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ba071-2832-4a74-a1bf-b416ac409d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:04.581304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ba071-2832-4a74-a1bf-b416ac409d97 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:04.581583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ba071-2832-4a74-a1bf-b416ac409d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:04.581912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ba071-2832-4a74-a1bf-b416ac409d97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:04.592785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ba071-2832-4a74-a1bf-b416ac409d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d39ba071-2832-4a74-a1bf-b416ac409d97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:04.597764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:04.599019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:04.599859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 526/1048] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:04.606942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1eaa56-f0ae-4fbd-81f0-b20c1f1bda98 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:04.681735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:04.715650 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1eaa56-f0ae-4fbd-81f0-b20c1f1bda98 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:04.750104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56234fb-53a9-4da5-950e-c371b9df9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:04.750711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56234fb-53a9-4da5-950e-c371b9df9f17 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:04.750989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56234fb-53a9-4da5-950e-c371b9df9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:04.751261 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56234fb-53a9-4da5-950e-c371b9df9f17 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:04.751914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56234fb-53a9-4da5-950e-c371b9df9f17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:04.752217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56234fb-53a9-4da5-950e-c371b9df9f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:04.753652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56234fb-53a9-4da5-950e-c371b9df9f17 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:04.762558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 523/1049] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:04.768246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ba071-2832-4a74-a1bf-b416ac409d97 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:04.870288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ba071-2832-4a74-a1bf-b416ac409d97 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:04.892429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:04.905507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674c402-5292-4ed3-9c88-a77b74962ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:04.906194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674c402-5292-4ed3-9c88-a77b74962ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:04.906476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674c402-5292-4ed3-9c88-a77b74962ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:04.906744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674c402-5292-4ed3-9c88-a77b74962ac7 None admin] PATH_INFO: `/v3/users/a30e3566fc074703828ff4a3a3b0bf18` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:04.922170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674c402-5292-4ed3-9c88-a77b74962ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=a30e3566fc074703828ff4a3a3b0bf18)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:04.923623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674c402-5292-4ed3-9c88-a77b74962ac7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:04.930227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 527/1050] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:04 2022] GET /identity/v3/users/a30e3566fc074703828ff4a3a3b0bf18 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:04.931795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56234fb-53a9-4da5-950e-c371b9df9f17 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:05.031873 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56234fb-53a9-4da5-950e-c371b9df9f17 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:05.062650 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:05.069640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d600-5f71-43b9-a566-34d29c88e215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:05.070254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d600-5f71-43b9-a566-34d29c88e215 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:05.070532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d600-5f71-43b9-a566-34d29c88e215 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:05.070805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d600-5f71-43b9-a566-34d29c88e215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:05.137963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89d600-5f71-43b9-a566-34d29c88e215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:05.139409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89d600-5f71-43b9-a566-34d29c88e215 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:05.146294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a17e8-6e39-4a6f-bb7f-5ec5ed536808 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:05.146587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a17e8-6e39-4a6f-bb7f-5ec5ed536808 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:05.146861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a17e8-6e39-4a6f-bb7f-5ec5ed536808 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:05.148169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 528/1051] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 12:00:05.154395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57e2a-08ff-45f2-bf69-865e0429ff39 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:05.154686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57e2a-08ff-45f2-bf69-865e0429ff39 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:05.154965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57e2a-08ff-45f2-bf69-865e0429ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:05.173025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cae57e2a-08ff-45f2-bf69-865e0429ff39 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:05.174238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cae57e2a-08ff-45f2-bf69-865e0429ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:05.243068 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 529/1052] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:00:05.246757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 524/1053] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 12:00:05.255448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae57e2a-08ff-45f2-bf69-865e0429ff39 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:05.353725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae57e2a-08ff-45f2-bf69-865e0429ff39 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:05.364994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:05.389584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa7b76-bc02-4f68-a30a-2f763a74fbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:05.390253 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa7b76-bc02-4f68-a30a-2f763a74fbea None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:05.390529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa7b76-bc02-4f68-a30a-2f763a74fbea None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:05.390798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa7b76-bc02-4f68-a30a-2f763a74fbea None admin] PATH_INFO: `/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:05.391898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa7b76-bc02-4f68-a30a-2f763a74fbea None admin] RBAC: Authorizing `identity:get_project(project_id=8c7df2ad43b44f36a6b16e2e2a87a2d0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:05.393309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa7b76-bc02-4f68-a30a-2f763a74fbea None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:05.395080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 530/1054] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:05 2022] GET /identity/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:05.401465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d600-5f71-43b9-a566-34d29c88e215 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:05.430741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:05.501523 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d600-5f71-43b9-a566-34d29c88e215 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:05.535425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8048e39-cd49-4451-b6c3-8127cf97cf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:05.536019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8048e39-cd49-4451-b6c3-8127cf97cf61 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:05.536296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8048e39-cd49-4451-b6c3-8127cf97cf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:05.536564 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8048e39-cd49-4451-b6c3-8127cf97cf61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:05.537281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8048e39-cd49-4451-b6c3-8127cf97cf61 None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=8c7df2ad43b44f36a6b16e2e2a87a2d0, user.id=a30e3566fc074703828ff4a3a3b0bf18) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:05.537585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8048e39-cd49-4451-b6c3-8127cf97cf61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:05.539016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8048e39-cd49-4451-b6c3-8127cf97cf61 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:05.545141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 525/1055] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:00:05 2022] GET /identity/v3/role_assignments?user.id=a30e3566fc074703828ff4a3a3b0bf18&scope.project.id=8c7df2ad43b44f36a6b16e2e2a87a2d0&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:05.552704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa7b76-bc02-4f68-a30a-2f763a74fbea None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:05.678246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa7b76-bc02-4f68-a30a-2f763a74fbea None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:05.717512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ce30d-9d26-42ab-8ca3-e8053cd35fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:05.717512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ce30d-9d26-42ab-8ca3-e8053cd35fca None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:05.717512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ce30d-9d26-42ab-8ca3-e8053cd35fca None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:05.717862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ce30d-9d26-42ab-8ca3-e8053cd35fca None admin] PATH_INFO: `/v3/services/image` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:05.718383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ce30d-9d26-42ab-8ca3-e8053cd35fca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:05.719768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ce30d-9d26-42ab-8ca3-e8053cd35fca None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-988ce30d-9d26-42ab-8ca3-e8053cd35fca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:05.732155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:05.733169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 12:00:05.734037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:05.737736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 531/1056] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Sep 19 12:00:05 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:05.742699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8048e39-cd49-4451-b6c3-8127cf97cf61 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:05.839921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:05.847516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8048e39-cd49-4451-b6c3-8127cf97cf61 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:05.883733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba36db-97e2-41f3-b4ae-da7e7296f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:05.884456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba36db-97e2-41f3-b4ae-da7e7296f6bd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:05.884736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba36db-97e2-41f3-b4ae-da7e7296f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:05.885038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba36db-97e2-41f3-b4ae-da7e7296f6bd None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:05.885752 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba36db-97e2-41f3-b4ae-da7e7296f6bd None admin] RBAC: Adding query filter params (name=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:05.886058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba36db-97e2-41f3-b4ae-da7e7296f6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:05.887442 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba36db-97e2-41f3-b4ae-da7e7296f6bd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:05.897393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 526/1057] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:05.898543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ce30d-9d26-42ab-8ca3-e8053cd35fca None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:05.941938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:05.999293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ce30d-9d26-42ab-8ca3-e8053cd35fca None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:06.035031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e6bf-3d7c-459f-9eec-79c19f01e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:06.035636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e6bf-3d7c-459f-9eec-79c19f01e61c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:06.035912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e6bf-3d7c-459f-9eec-79c19f01e61c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:06.036181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e6bf-3d7c-459f-9eec-79c19f01e61c None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:06.036797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e6bf-3d7c-459f-9eec-79c19f01e61c None admin] RBAC: Adding query filter params (type=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:06.037093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e6bf-3d7c-459f-9eec-79c19f01e61c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:06.038470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e6bf-3d7c-459f-9eec-79c19f01e61c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:06.044115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 532/1058] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:06.049983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba36db-97e2-41f3-b4ae-da7e7296f6bd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:06.156142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba36db-97e2-41f3-b4ae-da7e7296f6bd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:06.189797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162fcdd-b9b2-44c9-998f-13a67f49cf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:06.190407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162fcdd-b9b2-44c9-998f-13a67f49cf89 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:06.190685 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162fcdd-b9b2-44c9-998f-13a67f49cf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:06.190957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162fcdd-b9b2-44c9-998f-13a67f49cf89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:06.191631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162fcdd-b9b2-44c9-998f-13a67f49cf89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:06.193045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162fcdd-b9b2-44c9-998f-13a67f49cf89 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:06.221646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 527/1059] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:00:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:00:06.224067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a4f1d-b5b6-4cd1-a7e3-deb741611769 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:06.224358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a4f1d-b5b6-4cd1-a7e3-deb741611769 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:06.224640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a4f1d-b5b6-4cd1-a7e3-deb741611769 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:06.226039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 533/1060] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:06.232014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333acf-c3d1-41e1-9760-c88e18c1655a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:06.232444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333acf-c3d1-41e1-9760-c88e18c1655a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:06.232817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333acf-c3d1-41e1-9760-c88e18c1655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:06.252996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-79333acf-c3d1-41e1-9760-c88e18c1655a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:06.254418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79333acf-c3d1-41e1-9760-c88e18c1655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:06.269034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:06.348589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 528/1061] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:06.617984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a4f1d-b5b6-4cd1-a7e3-deb741611769 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:06.726769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a4f1d-b5b6-4cd1-a7e3-deb741611769 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:06.735246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:06.764323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fae74-c067-46b7-82f0-c6b0058b729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:06.764958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fae74-c067-46b7-82f0-c6b0058b729e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:06.765235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fae74-c067-46b7-82f0-c6b0058b729e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:06.765504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fae74-c067-46b7-82f0-c6b0058b729e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:06.775728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fae74-c067-46b7-82f0-c6b0058b729e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cb5fae74-c067-46b7-82f0-c6b0058b729e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:06.780581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:06.781556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 12:00:06.782506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:06.785942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 534/1062] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 19 12:00:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:06.787806 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333acf-c3d1-41e1-9760-c88e18c1655a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:06.890010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333acf-c3d1-41e1-9760-c88e18c1655a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:06.924624 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab79fe-8e49-4ede-8c8c-2bdfefd8c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:06.925233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab79fe-8e49-4ede-8c8c-2bdfefd8c5ca None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:06.925512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab79fe-8e49-4ede-8c8c-2bdfefd8c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:06.925812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab79fe-8e49-4ede-8c8c-2bdfefd8c5ca None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:06.926471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab79fe-8e49-4ede-8c8c-2bdfefd8c5ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:06.926773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab79fe-8e49-4ede-8c8c-2bdfefd8c5ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:06.928131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab79fe-8e49-4ede-8c8c-2bdfefd8c5ca None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:06.940919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 529/1063] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 19 12:00:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:06.942916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fae74-c067-46b7-82f0-c6b0058b729e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:07.044071 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fae74-c067-46b7-82f0-c6b0058b729e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:07.077329 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0084dd-a886-470f-9aca-5e28b2ae9a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:07.077992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0084dd-a886-470f-9aca-5e28b2ae9a5f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:07.078268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0084dd-a886-470f-9aca-5e28b2ae9a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:07.078533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0084dd-a886-470f-9aca-5e28b2ae9a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:07.089307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0084dd-a886-470f-9aca-5e28b2ae9a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:07.090775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0084dd-a886-470f-9aca-5e28b2ae9a5f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2e0084dd-a886-470f-9aca-5e28b2ae9a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:00:07.105743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:07.106722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:00:07.107616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:00:07.107616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:07.107616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:07.109937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 535/1064] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:07.112626 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab79fe-8e49-4ede-8c8c-2bdfefd8c5ca None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:07.115773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:07.219504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab79fe-8e49-4ede-8c8c-2bdfefd8c5ca None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:07.254660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0b25f-42a4-4668-99f1-3beb1678b15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:07.255267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0b25f-42a4-4668-99f1-3beb1678b15d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:07.255543 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0b25f-42a4-4668-99f1-3beb1678b15d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:07.255817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0b25f-42a4-4668-99f1-3beb1678b15d None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:07.256454 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0b25f-42a4-4668-99f1-3beb1678b15d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:07.256755 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0b25f-42a4-4668-99f1-3beb1678b15d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:07.258145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0b25f-42a4-4668-99f1-3beb1678b15d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:07.275920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 530/1065] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:07.277744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0084dd-a886-470f-9aca-5e28b2ae9a5f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:07.298972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:07.381868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0084dd-a886-470f-9aca-5e28b2ae9a5f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:07.414413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4757f-d633-4f5c-8f6e-c86a7d6d3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:07.415033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4757f-d633-4f5c-8f6e-c86a7d6d3b7b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:07.415853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4757f-d633-4f5c-8f6e-c86a7d6d3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:07.416279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4757f-d633-4f5c-8f6e-c86a7d6d3b7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:07.423704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4757f-d633-4f5c-8f6e-c86a7d6d3b7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:07.425132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4757f-d633-4f5c-8f6e-c86a7d6d3b7b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9ff4757f-d633-4f5c-8f6e-c86a7d6d3b7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 12:00:07.436601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:07.437562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:07.438843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:07.438843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:07.438843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 12:00:07.438843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 12:00:07.438843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 12:00:07.438843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 12:00:07.438843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 12:00:07.438843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 12:00:07.438843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 12:00:07.438843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:07.441939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 536/1066] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 19 12:00:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:07.443556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0b25f-42a4-4668-99f1-3beb1678b15d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:07.507662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:07.548563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0b25f-42a4-4668-99f1-3beb1678b15d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:07.584511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaa76e-e952-4c63-9c38-8b2f407a5a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:07.585149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa76e-e952-4c63-9c38-8b2f407a5a35 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:07.585427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa76e-e952-4c63-9c38-8b2f407a5a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:07.585729 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa76e-e952-4c63-9c38-8b2f407a5a35 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:07.586474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaa76e-e952-4c63-9c38-8b2f407a5a35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:07.586784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaa76e-e952-4c63-9c38-8b2f407a5a35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:07.588414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaa76e-e952-4c63-9c38-8b2f407a5a35 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:07.613448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 531/1067] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 19 12:00:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:07.615372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4757f-d633-4f5c-8f6e-c86a7d6d3b7b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:07.700533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:07.703486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162a564-f699-4e3c-a2dc-3887e9c5f80b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:07.703792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162a564-f699-4e3c-a2dc-3887e9c5f80b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:07.704028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162a564-f699-4e3c-a2dc-3887e9c5f80b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:07.705805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 532/1068] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:07.710654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc4731-146c-4aaa-9e22-f7584ab12148 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:07.710938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc4731-146c-4aaa-9e22-f7584ab12148 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:07.711611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc4731-146c-4aaa-9e22-f7584ab12148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:07.725380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4757f-d633-4f5c-8f6e-c86a7d6d3b7b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:07.730490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-efcc4731-146c-4aaa-9e22-f7584ab12148 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:07.731670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-efcc4731-146c-4aaa-9e22-f7584ab12148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:07.762731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd84134-e2a7-4f24-bf69-f876498c2161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:07.763636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd84134-e2a7-4f24-bf69-f876498c2161 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:07.763918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd84134-e2a7-4f24-bf69-f876498c2161 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:07.764189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd84134-e2a7-4f24-bf69-f876498c2161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:07.777700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd84134-e2a7-4f24-bf69-f876498c2161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:07.779314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd84134-e2a7-4f24-bf69-f876498c2161 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2dd84134-e2a7-4f24-bf69-f876498c2161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:00:07.798192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:07.799125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:00:07.800009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:00:07.800009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:07.800009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:07.800009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 537/1069] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:07.807740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 533/1070] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:00:07.808245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd84134-e2a7-4f24-bf69-f876498c2161 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:07.906897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd84134-e2a7-4f24-bf69-f876498c2161 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:07.934756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:07.942111 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424f42c-e4d9-4fd5-8973-a3402bc6cce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:07.942719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424f42c-e4d9-4fd5-8973-a3402bc6cce6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:07.942998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424f42c-e4d9-4fd5-8973-a3402bc6cce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:07.943270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424f42c-e4d9-4fd5-8973-a3402bc6cce6 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:07.943904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424f42c-e4d9-4fd5-8973-a3402bc6cce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:07.944212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424f42c-e4d9-4fd5-8973-a3402bc6cce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:07.945568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424f42c-e4d9-4fd5-8973-a3402bc6cce6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:07.958542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 538/1071] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:07.964405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc4731-146c-4aaa-9e22-f7584ab12148 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:08.015273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:08.067551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424f42c-e4d9-4fd5-8973-a3402bc6cce6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:08.067746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc4731-146c-4aaa-9e22-f7584ab12148 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:08.104662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb792704-0e19-4248-8896-57fb6567c0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:08.105311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb792704-0e19-4248-8896-57fb6567c0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:08.105612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb792704-0e19-4248-8896-57fb6567c0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:08.105865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb792704-0e19-4248-8896-57fb6567c0d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:08.112425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb792704-0e19-4248-8896-57fb6567c0d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:08.113888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb792704-0e19-4248-8896-57fb6567c0d1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-eb792704-0e19-4248-8896-57fb6567c0d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 12:00:08.125376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:08.126459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:08.127357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 12:00:08.127357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 12:00:08.127357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 12:00:08.127357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 12:00:08.127357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 12:00:08.127357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 12:00:08.127357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:00:08.127357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:08.127357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 534/1072] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 12:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:08.132182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb792704-0e19-4248-8896-57fb6567c0d1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:08.188883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424f42c-e4d9-4fd5-8973-a3402bc6cce6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:08.228479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd087fc-aabf-4104-977d-6dd364a0a3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:08.229193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd087fc-aabf-4104-977d-6dd364a0a3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:08.229480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd087fc-aabf-4104-977d-6dd364a0a3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:08.229783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd087fc-aabf-4104-977d-6dd364a0a3f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:08.238492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb792704-0e19-4248-8896-57fb6567c0d1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:08.239815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd087fc-aabf-4104-977d-6dd364a0a3f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5fd087fc-aabf-4104-977d-6dd364a0a3f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:08.245218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:08.246200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:08.247048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 539/1073] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:00:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:08.252283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd087fc-aabf-4104-977d-6dd364a0a3f4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:08.254517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:08.280999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db3def-c6a6-4b9d-b6bd-c8568bb31c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:08.281437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db3def-c6a6-4b9d-b6bd-c8568bb31c99 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:08.281724 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db3def-c6a6-4b9d-b6bd-c8568bb31c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:08.282091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db3def-c6a6-4b9d-b6bd-c8568bb31c99 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:08.282681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db3def-c6a6-4b9d-b6bd-c8568bb31c99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:08.282989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db3def-c6a6-4b9d-b6bd-c8568bb31c99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:08.284410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db3def-c6a6-4b9d-b6bd-c8568bb31c99 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:08.297286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 535/1074] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 12:00:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:08.303163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db3def-c6a6-4b9d-b6bd-c8568bb31c99 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:08.304450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:08.362641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd087fc-aabf-4104-977d-6dd364a0a3f4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:08.397813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b93db-84c9-4b11-bed4-ecf654c21122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:08.398425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b93db-84c9-4b11-bed4-ecf654c21122 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:08.398706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b93db-84c9-4b11-bed4-ecf654c21122 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:08.398977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b93db-84c9-4b11-bed4-ecf654c21122 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:08.400140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b93db-84c9-4b11-bed4-ecf654c21122 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:08.400548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b93db-84c9-4b11-bed4-ecf654c21122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:08.402147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b93db-84c9-4b11-bed4-ecf654c21122 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:08.410564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 540/1075] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:00:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:08.416993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b93db-84c9-4b11-bed4-ecf654c21122 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:08.422163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db3def-c6a6-4b9d-b6bd-c8568bb31c99 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:08.456899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef7d95-36ed-4a40-b150-87fc114aa50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:08.457538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef7d95-36ed-4a40-b150-87fc114aa50d None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:08.457855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef7d95-36ed-4a40-b150-87fc114aa50d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:08.458128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef7d95-36ed-4a40-b150-87fc114aa50d None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/02430b0097f94fa0a2015480a6ec68eb/roles/60dc3e6f759b4f9f9b5bab5fc1be0d0e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:08.460297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef7d95-36ed-4a40-b150-87fc114aa50d None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=02430b0097f94fa0a2015480a6ec68eb, role_id=60dc3e6f759b4f9f9b5bab5fc1be0d0e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:08.461745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef7d95-36ed-4a40-b150-87fc114aa50d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:08.483011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 536/1076] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 12:00:08 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/02430b0097f94fa0a2015480a6ec68eb/roles/60dc3e6f759b4f9f9b5bab5fc1be0d0e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:00:08.484231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6ac79-e946-40fe-8b52-2ca455f68b36 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:08.484512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6ac79-e946-40fe-8b52-2ca455f68b36 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:08.484785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6ac79-e946-40fe-8b52-2ca455f68b36 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:08.486043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 537/1077] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:08.491738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d747268-d8be-49e4-9a1d-0aee2b133642 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:08.492021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d747268-d8be-49e4-9a1d-0aee2b133642 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:08.492298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d747268-d8be-49e4-9a1d-0aee2b133642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:08.511662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4d747268-d8be-49e4-9a1d-0aee2b133642 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:08.512892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4d747268-d8be-49e4-9a1d-0aee2b133642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:08.534653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b93db-84c9-4b11-bed4-ecf654c21122 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:08.538997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:08.553115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:08.582210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327df3fd-410b-4cca-9331-da581686925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:08.583002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327df3fd-410b-4cca-9331-da581686925b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:08.583293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327df3fd-410b-4cca-9331-da581686925b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:08.583572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327df3fd-410b-4cca-9331-da581686925b None admin] PATH_INFO: `/v3/users/a30e3566fc074703828ff4a3a3b0bf18` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:08.584808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327df3fd-410b-4cca-9331-da581686925b None admin] RBAC: Authorizing `identity:get_user(user_id=a30e3566fc074703828ff4a3a3b0bf18)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:08.586296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327df3fd-410b-4cca-9331-da581686925b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:08.588684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 541/1078] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:08 2022] GET /identity/v3/users/a30e3566fc074703828ff4a3a3b0bf18 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:08.591728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 538/1079] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:00:08.594331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327df3fd-410b-4cca-9331-da581686925b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:08.724467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327df3fd-410b-4cca-9331-da581686925b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:08.758139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9002e-c8f5-4cf2-a5c7-103823c5140b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:08.758729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9002e-c8f5-4cf2-a5c7-103823c5140b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:08.759057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9002e-c8f5-4cf2-a5c7-103823c5140b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:08.759346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9002e-c8f5-4cf2-a5c7-103823c5140b None admin] PATH_INFO: `/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:08.760479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9002e-c8f5-4cf2-a5c7-103823c5140b None admin] RBAC: Authorizing `identity:get_project(project_id=8c7df2ad43b44f36a6b16e2e2a87a2d0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:08.761921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9002e-c8f5-4cf2-a5c7-103823c5140b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:08.763744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 542/1080] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:08 2022] GET /identity/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:08.769439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d747268-d8be-49e4-9a1d-0aee2b133642 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:08.863521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9002e-c8f5-4cf2-a5c7-103823c5140b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:08.875569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d747268-d8be-49e4-9a1d-0aee2b133642 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:08.916884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9c6fc-2d09-445d-93ab-c849ec189749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:08.917124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:08.917541 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9c6fc-2d09-445d-93ab-c849ec189749 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:08.917931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9c6fc-2d09-445d-93ab-c849ec189749 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:08.918152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9c6fc-2d09-445d-93ab-c849ec189749 None admin] PATH_INFO: `/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0/users/a30e3566fc074703828ff4a3a3b0bf18/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:08.920034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9c6fc-2d09-445d-93ab-c849ec189749 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c7df2ad43b44f36a6b16e2e2a87a2d0, user_id=a30e3566fc074703828ff4a3a3b0bf18, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:08.921813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9c6fc-2d09-445d-93ab-c849ec189749 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:08.934614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 539/1081] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 12:00:08 2022] PUT /identity/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0/users/a30e3566fc074703828ff4a3a3b0bf18/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:00:08.977595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9002e-c8f5-4cf2-a5c7-103823c5140b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:09.015502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225845-4d15-4471-a9be-f876d715f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:09.016131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225845-4d15-4471-a9be-f876d715f5ab None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:09.016408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225845-4d15-4471-a9be-f876d715f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:09.016680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225845-4d15-4471-a9be-f876d715f5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:09.089406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225845-4d15-4471-a9be-f876d715f5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:09.090918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225845-4d15-4471-a9be-f876d715f5ab None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:09.141262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:09.194499 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 543/1082] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 12:00:09.200901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9c6fc-2d09-445d-93ab-c849ec189749 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:09.224105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:09.306693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9c6fc-2d09-445d-93ab-c849ec189749 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:09.340553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f568ce-8af2-47a0-a014-2118c3160d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:09.341244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f568ce-8af2-47a0-a014-2118c3160d61 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:09.341530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f568ce-8af2-47a0-a014-2118c3160d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:09.341901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f568ce-8af2-47a0-a014-2118c3160d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:09.353004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f568ce-8af2-47a0-a014-2118c3160d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:09.354484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f568ce-8af2-47a0-a014-2118c3160d61 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-18f568ce-8af2-47a0-a014-2118c3160d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:00:09.369824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:09.370780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:00:09.371745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:00:09.371745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:09.371745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:09.371745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 540/1083] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:09.377853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225845-4d15-4471-a9be-f876d715f5ab None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:09.477589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225845-4d15-4471-a9be-f876d715f5ab None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:09.511580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff30ce9-3b71-4841-9064-21a68945ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:09.512186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff30ce9-3b71-4841-9064-21a68945ac70 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:09.512464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff30ce9-3b71-4841-9064-21a68945ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:09.512733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff30ce9-3b71-4841-9064-21a68945ac70 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:09.513363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff30ce9-3b71-4841-9064-21a68945ac70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:09.513698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff30ce9-3b71-4841-9064-21a68945ac70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:09.515055 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff30ce9-3b71-4841-9064-21a68945ac70 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:09.526370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 544/1084] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:10.680424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887b46-3c86-4d7a-9a93-7f7ea949bab3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:10.681458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887b46-3c86-4d7a-9a93-7f7ea949bab3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:10.681562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887b46-3c86-4d7a-9a93-7f7ea949bab3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:10.682874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 541/1085] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:10.688021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae54ae-2c2a-4810-8f96-c7c446be97d0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:10.688425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae54ae-2c2a-4810-8f96-c7c446be97d0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:10.688569 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae54ae-2c2a-4810-8f96-c7c446be97d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:10.707166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-eaae54ae-2c2a-4810-8f96-c7c446be97d0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:10.708327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eaae54ae-2c2a-4810-8f96-c7c446be97d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:10.710282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:10.774234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 545/1086] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:11.043274 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887b46-3c86-4d7a-9a93-7f7ea949bab3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:11.105379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87d84d-f87b-455e-af46-b8e1dfab7808 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.105694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87d84d-f87b-455e-af46-b8e1dfab7808 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.105976 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87d84d-f87b-455e-af46-b8e1dfab7808 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.107308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 546/1087] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 12:00:11.112218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3669e-31ff-484c-9764-d49dda230da9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.112502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3669e-31ff-484c-9764-d49dda230da9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.112777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3669e-31ff-484c-9764-d49dda230da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.114211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:11.130909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7ff3669e-31ff-484c-9764-d49dda230da9 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:11.132098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7ff3669e-31ff-484c-9764-d49dda230da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:11.146278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887b46-3c86-4d7a-9a93-7f7ea949bab3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:11.180048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838999fc-c795-4d64-b0a4-f5a8541effa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:11.180673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838999fc-c795-4d64-b0a4-f5a8541effa6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.180982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838999fc-c795-4d64-b0a4-f5a8541effa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.181255 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838999fc-c795-4d64-b0a4-f5a8541effa6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.191700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838999fc-c795-4d64-b0a4-f5a8541effa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-838999fc-c795-4d64-b0a4-f5a8541effa6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:11.196997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:11.198322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:11.199390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 542/1088] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 19 12:00:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:11.201649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 547/1089] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:00:11.204099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838999fc-c795-4d64-b0a4-f5a8541effa6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:11.300704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838999fc-c795-4d64-b0a4-f5a8541effa6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:11.328235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:11.333690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2454122-9a8a-446c-be82-313773cc8a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:11.334289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2454122-9a8a-446c-be82-313773cc8a0d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.334564 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2454122-9a8a-446c-be82-313773cc8a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.334833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2454122-9a8a-446c-be82-313773cc8a0d None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.335487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2454122-9a8a-446c-be82-313773cc8a0d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:11.335786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2454122-9a8a-446c-be82-313773cc8a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:11.337911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2454122-9a8a-446c-be82-313773cc8a0d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:11.346296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 543/1090] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 19 12:00:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:11.352466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3669e-31ff-484c-9764-d49dda230da9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:11.417252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:11.449838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3669e-31ff-484c-9764-d49dda230da9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:11.471370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2454122-9a8a-446c-be82-313773cc8a0d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:11.483041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713f893-8d37-45c5-967e-ff4543ecb813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:11.483671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713f893-8d37-45c5-967e-ff4543ecb813 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.483956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713f893-8d37-45c5-967e-ff4543ecb813 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.484228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713f893-8d37-45c5-967e-ff4543ecb813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.494708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713f893-8d37-45c5-967e-ff4543ecb813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:11.496143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713f893-8d37-45c5-967e-ff4543ecb813 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-4713f893-8d37-45c5-967e-ff4543ecb813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:00:11.510926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:11.512047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:00:11.512961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:00:11.512961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:11.512961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:11.513774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 548/1091] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:11.517641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713f893-8d37-45c5-967e-ff4543ecb813 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:11.570355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2454122-9a8a-446c-be82-313773cc8a0d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:11.603983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdda51-5bf3-4c5b-a432-bef7540206f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:11.604600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdda51-5bf3-4c5b-a432-bef7540206f0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.604876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdda51-5bf3-4c5b-a432-bef7540206f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.605142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdda51-5bf3-4c5b-a432-bef7540206f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.614191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713f893-8d37-45c5-967e-ff4543ecb813 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:11.614769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdda51-5bf3-4c5b-a432-bef7540206f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-19fdda51-5bf3-4c5b-a432-bef7540206f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:11.620046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:11.621012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:11.621907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 544/1092] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 12:00:11.626973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdda51-5bf3-4c5b-a432-bef7540206f0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:11.636427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:11.650872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691584bc-fb3d-463b-847f-92a8fcb8ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:11.651476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691584bc-fb3d-463b-847f-92a8fcb8ac14 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.651756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691584bc-fb3d-463b-847f-92a8fcb8ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.652030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691584bc-fb3d-463b-847f-92a8fcb8ac14 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.652654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691584bc-fb3d-463b-847f-92a8fcb8ac14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:11.652952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691584bc-fb3d-463b-847f-92a8fcb8ac14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:11.654333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691584bc-fb3d-463b-847f-92a8fcb8ac14 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:11.666141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 549/1093] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:11.672355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691584bc-fb3d-463b-847f-92a8fcb8ac14 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:11.686697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:11.731356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdda51-5bf3-4c5b-a432-bef7540206f0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:11.765856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2a837-95c9-490d-a260-fe606210727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:11.766450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2a837-95c9-490d-a260-fe606210727d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.766734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2a837-95c9-490d-a260-fe606210727d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.767012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2a837-95c9-490d-a260-fe606210727d None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.767675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2a837-95c9-490d-a260-fe606210727d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:11.767982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2a837-95c9-490d-a260-fe606210727d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:11.769360 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2a837-95c9-490d-a260-fe606210727d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:11.770213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691584bc-fb3d-463b-847f-92a8fcb8ac14 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:11.777782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 545/1094] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:11.783606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2a837-95c9-490d-a260-fe606210727d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:11.807723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa5b32-53de-4f79-b96a-a42b743837d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:11.808297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa5b32-53de-4f79-b96a-a42b743837d9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.808572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa5b32-53de-4f79-b96a-a42b743837d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.808842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa5b32-53de-4f79-b96a-a42b743837d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.816437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa5b32-53de-4f79-b96a-a42b743837d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:11.817908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa5b32-53de-4f79-b96a-a42b743837d9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1bfa5b32-53de-4f79-b96a-a42b743837d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 12:00:11.829653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:11.830799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:11.831970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 550/1095] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 19 12:00:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 12:00:11.836848 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa5b32-53de-4f79-b96a-a42b743837d9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:11.882182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:11.887572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2a837-95c9-490d-a260-fe606210727d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:11.903990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:11.922046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad9ea6-d016-46e3-a1e7-01e90a2120fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:11.922678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9ea6-d016-46e3-a1e7-01e90a2120fc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.922970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9ea6-d016-46e3-a1e7-01e90a2120fc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.923248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9ea6-d016-46e3-a1e7-01e90a2120fc None admin] PATH_INFO: `/v3/users/a30e3566fc074703828ff4a3a3b0bf18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.924373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad9ea6-d016-46e3-a1e7-01e90a2120fc None admin] RBAC: Authorizing `identity:get_user(user_id=a30e3566fc074703828ff4a3a3b0bf18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:11.925834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad9ea6-d016-46e3-a1e7-01e90a2120fc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:11.927413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 546/1096] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:11 2022] GET /identity/v3/users/a30e3566fc074703828ff4a3a3b0bf18 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:11.933845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad9ea6-d016-46e3-a1e7-01e90a2120fc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:11.943994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa5b32-53de-4f79-b96a-a42b743837d9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:11.978341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a48b6-23f8-4771-8da3-30f5ff3e4842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:11.979020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a48b6-23f8-4771-8da3-30f5ff3e4842 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:11.979298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a48b6-23f8-4771-8da3-30f5ff3e4842 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:11.979568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a48b6-23f8-4771-8da3-30f5ff3e4842 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:11.980272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a48b6-23f8-4771-8da3-30f5ff3e4842 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:11.980576 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a48b6-23f8-4771-8da3-30f5ff3e4842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:11.981998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a48b6-23f8-4771-8da3-30f5ff3e4842 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:11.999160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 551/1097] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 19 12:00:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:12.004864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a48b6-23f8-4771-8da3-30f5ff3e4842 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:12.031750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad9ea6-d016-46e3-a1e7-01e90a2120fc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:12.067154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5570e8f-8d17-41ad-8f7c-821e26fc6a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:12.067762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5570e8f-8d17-41ad-8f7c-821e26fc6a3a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:12.068038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5570e8f-8d17-41ad-8f7c-821e26fc6a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:12.068311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5570e8f-8d17-41ad-8f7c-821e26fc6a3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:12.097448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:12.101754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a48b6-23f8-4771-8da3-30f5ff3e4842 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:12.119943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:12.136258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5570e8f-8d17-41ad-8f7c-821e26fc6a3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:12.137766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5570e8f-8d17-41ad-8f7c-821e26fc6a3a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:12.139686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dcfc9-ac90-426f-be64-3079aee9c4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:12.140309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dcfc9-ac90-426f-be64-3079aee9c4de None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:12.140586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dcfc9-ac90-426f-be64-3079aee9c4de None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:12.140855 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dcfc9-ac90-426f-be64-3079aee9c4de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:12.223379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dcfc9-ac90-426f-be64-3079aee9c4de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:12.225307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dcfc9-ac90-426f-be64-3079aee9c4de None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:12.251046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 547/1098] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 12:00:12.256675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5570e8f-8d17-41ad-8f7c-821e26fc6a3a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:12.339693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:12.340123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:12.345740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 552/1099] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 12:00:12.351760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dcfc9-ac90-426f-be64-3079aee9c4de None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:12.361839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5570e8f-8d17-41ad-8f7c-821e26fc6a3a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:12.398201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03d0be-5950-4d47-9ae0-e0643e345b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:12.398832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d0be-5950-4d47-9ae0-e0643e345b6a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:12.399111 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d0be-5950-4d47-9ae0-e0643e345b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:12.399383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d0be-5950-4d47-9ae0-e0643e345b6a None admin] PATH_INFO: `/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:12.401156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03d0be-5950-4d47-9ae0-e0643e345b6a None admin] RBAC: Authorizing `identity:get_project(project_id=8c7df2ad43b44f36a6b16e2e2a87a2d0)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:12.402610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03d0be-5950-4d47-9ae0-e0643e345b6a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:12.404423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 548/1100] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:12 2022] GET /identity/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:12.410211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03d0be-5950-4d47-9ae0-e0643e345b6a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:12.474406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dcfc9-ac90-426f-be64-3079aee9c4de None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:12.508646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a0af2-2ddd-43e7-8466-2f2ee5cc4c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:12.509964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a0af2-2ddd-43e7-8466-2f2ee5cc4c36 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:12.510240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a0af2-2ddd-43e7-8466-2f2ee5cc4c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:12.510510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a0af2-2ddd-43e7-8466-2f2ee5cc4c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:12.513279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03d0be-5950-4d47-9ae0-e0643e345b6a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:12.520144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a0af2-2ddd-43e7-8466-2f2ee5cc4c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:12.521565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a0af2-2ddd-43e7-8466-2f2ee5cc4c36 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-dc2a0af2-2ddd-43e7-8466-2f2ee5cc4c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:00:12.536644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:12.537683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:00:12.538597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:00:12.538597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:00:12.538597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:12.538597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 553/1101] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 12:00:12.544243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a0af2-2ddd-43e7-8466-2f2ee5cc4c36 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:12.547134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecb298-8c84-4ea3-93c2-b5a618e7393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:12.547737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb298-8c84-4ea3-93c2-b5a618e7393c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:12.548012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb298-8c84-4ea3-93c2-b5a618e7393c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:12.548284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb298-8c84-4ea3-93c2-b5a618e7393c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:12.548989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecb298-8c84-4ea3-93c2-b5a618e7393c None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=8c7df2ad43b44f36a6b16e2e2a87a2d0, user.id=a30e3566fc074703828ff4a3a3b0bf18) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:12.549294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecb298-8c84-4ea3-93c2-b5a618e7393c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:12.550734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecb298-8c84-4ea3-93c2-b5a618e7393c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:12.557297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 549/1102] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:00:12 2022] GET /identity/v3/role_assignments?user.id=a30e3566fc074703828ff4a3a3b0bf18&scope.project.id=8c7df2ad43b44f36a6b16e2e2a87a2d0&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:12.596803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:12.651921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a0af2-2ddd-43e7-8466-2f2ee5cc4c36 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:12.687494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564ef48-afa6-4be1-9776-345821b9d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:12.688105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564ef48-afa6-4be1-9776-345821b9d558 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:12.688383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564ef48-afa6-4be1-9776-345821b9d558 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:12.688654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564ef48-afa6-4be1-9776-345821b9d558 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:12.689320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564ef48-afa6-4be1-9776-345821b9d558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:12.689597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564ef48-afa6-4be1-9776-345821b9d558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:12.690984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564ef48-afa6-4be1-9776-345821b9d558 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:12.704408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 554/1103] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:12.710180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecb298-8c84-4ea3-93c2-b5a618e7393c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:12.729776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:12.811837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecb298-8c84-4ea3-93c2-b5a618e7393c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:12.845408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c058-8a8f-4f37-a4ce-61634e268f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:12.846062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c058-8a8f-4f37-a4ce-61634e268f8c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:12.846345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c058-8a8f-4f37-a4ce-61634e268f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:12.846620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c058-8a8f-4f37-a4ce-61634e268f8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:12.853677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c058-8a8f-4f37-a4ce-61634e268f8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:12.855149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c058-8a8f-4f37-a4ce-61634e268f8c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-aa12c058-8a8f-4f37-a4ce-61634e268f8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 12:00:12.866277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:12.867281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:12.868160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 12:00:12.868160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 12:00:12.868160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 12:00:12.868160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 12:00:12.868160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 12:00:12.868160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 12:00:12.868160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:00:12.868160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:12.868160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 550/1104] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 12:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:12.874037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564ef48-afa6-4be1-9776-345821b9d558 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:12.971256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564ef48-afa6-4be1-9776-345821b9d558 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:12.982453 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:13.005558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3aefe-ef89-44b0-82a4-8643807c7738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:13.006190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3aefe-ef89-44b0-82a4-8643807c7738 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:13.006472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3aefe-ef89-44b0-82a4-8643807c7738 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:13.006745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3aefe-ef89-44b0-82a4-8643807c7738 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:13.007423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3aefe-ef89-44b0-82a4-8643807c7738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:13.007727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3aefe-ef89-44b0-82a4-8643807c7738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:13.009181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3aefe-ef89-44b0-82a4-8643807c7738 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:13.020475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 555/1105] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 12:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:13.027008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c058-8a8f-4f37-a4ce-61634e268f8c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:13.104161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:13.126961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c058-8a8f-4f37-a4ce-61634e268f8c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:13.159217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99629d-d077-4c2f-822a-19026288992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:13.159811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99629d-d077-4c2f-822a-19026288992c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:13.160087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99629d-d077-4c2f-822a-19026288992c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:13.160356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99629d-d077-4c2f-822a-19026288992c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:13.161062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99629d-d077-4c2f-822a-19026288992c None admin] RBAC: Adding query filter params (role.id=60dc3e6f759b4f9f9b5bab5fc1be0d0e, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=02430b0097f94fa0a2015480a6ec68eb) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:13.161366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99629d-d077-4c2f-822a-19026288992c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:13.162806 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99629d-d077-4c2f-822a-19026288992c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:13.169207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 551/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:00:13 2022] GET /identity/v3/role_assignments?user.id=02430b0097f94fa0a2015480a6ec68eb&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=60dc3e6f759b4f9f9b5bab5fc1be0d0e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:14.737596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9806ec-3042-4d72-88dc-fa871d298981 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:14.738097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9806ec-3042-4d72-88dc-fa871d298981 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:14.738187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9806ec-3042-4d72-88dc-fa871d298981 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:14.739479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 556/1107] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:14.745474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac135a94-ca97-4c26-a7ec-694285526410 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:14.745892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac135a94-ca97-4c26-a7ec-694285526410 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:14.746059 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac135a94-ca97-4c26-a7ec-694285526410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:14.764240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ac135a94-ca97-4c26-a7ec-694285526410 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:14.765415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ac135a94-ca97-4c26-a7ec-694285526410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:14.830526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 552/1108] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:00:15.099509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9806ec-3042-4d72-88dc-fa871d298981 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:15.207764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9806ec-3042-4d72-88dc-fa871d298981 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:15.241660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46619baa-6d26-42aa-a56a-9e808ff3771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:15.242282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46619baa-6d26-42aa-a56a-9e808ff3771f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:15.242563 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46619baa-6d26-42aa-a56a-9e808ff3771f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:15.242835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46619baa-6d26-42aa-a56a-9e808ff3771f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:15.244323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46619baa-6d26-42aa-a56a-9e808ff3771f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:15.245765 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46619baa-6d26-42aa-a56a-9e808ff3771f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:15.247324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 557/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:15.253049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac135a94-ca97-4c26-a7ec-694285526410 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:15.318518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:15.349939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac135a94-ca97-4c26-a7ec-694285526410 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:15.383070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903bb8a-9eeb-49de-8fff-2ccc3b25f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:15.383662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903bb8a-9eeb-49de-8fff-2ccc3b25f008 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:15.384122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903bb8a-9eeb-49de-8fff-2ccc3b25f008 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:15.384791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903bb8a-9eeb-49de-8fff-2ccc3b25f008 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:15.385218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903bb8a-9eeb-49de-8fff-2ccc3b25f008 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:15.386742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903bb8a-9eeb-49de-8fff-2ccc3b25f008 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:15.407368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 553/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 12:00:15 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:00:17.572468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682996-d225-4c3d-9adb-f8e5c6e8ca1d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:17.573009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682996-d225-4c3d-9adb-f8e5c6e8ca1d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:17.573009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682996-d225-4c3d-9adb-f8e5c6e8ca1d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:17.574349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 558/1111] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:17.579439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442585-d840-418f-85df-e321584f369d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:17.579804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442585-d840-418f-85df-e321584f369d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:17.579993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442585-d840-418f-85df-e321584f369d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:17.597702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2d442585-d840-418f-85df-e321584f369d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:17.599151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2d442585-d840-418f-85df-e321584f369d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:17.662972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 554/1112] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:17.929357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73682996-d225-4c3d-9adb-f8e5c6e8ca1d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:17.968792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:18.026433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73682996-d225-4c3d-9adb-f8e5c6e8ca1d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:18.058442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ee0f8-642c-4ddf-aae7-5d86a7f34eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:18.059050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ee0f8-642c-4ddf-aae7-5d86a7f34eeb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:18.059325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ee0f8-642c-4ddf-aae7-5d86a7f34eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:18.059595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ee0f8-642c-4ddf-aae7-5d86a7f34eeb None admin] PATH_INFO: `/v3/roles/c59031d5db354a478ab7a9ac0000e098` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:18.060943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ee0f8-642c-4ddf-aae7-5d86a7f34eeb None admin] RBAC: Authorizing `identity:get_role(role_id=c59031d5db354a478ab7a9ac0000e098)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:18.062317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ee0f8-642c-4ddf-aae7-5d86a7f34eeb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:18.063585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 559/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:17 2022] GET /identity/v3/roles/c59031d5db354a478ab7a9ac0000e098 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:18.069276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d442585-d840-418f-85df-e321584f369d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:18.123619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:18.165446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d442585-d840-418f-85df-e321584f369d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:18.198465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a0324-bf05-40f1-a0f3-6e40f1ff2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:18.199025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a0324-bf05-40f1-a0f3-6e40f1ff2df8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:18.199305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a0324-bf05-40f1-a0f3-6e40f1ff2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:18.199575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a0324-bf05-40f1-a0f3-6e40f1ff2df8 None admin] PATH_INFO: `/v3/users/c8dd703e2ba04d299d5ae43d132f11a5` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:18.212533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a0324-bf05-40f1-a0f3-6e40f1ff2df8 None admin] RBAC: Authorizing `identity:get_user(user_id=c8dd703e2ba04d299d5ae43d132f11a5)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:18.213981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a0324-bf05-40f1-a0f3-6e40f1ff2df8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:18.215557 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 555/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:18 2022] GET /identity/v3/users/c8dd703e2ba04d299d5ae43d132f11a5 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:18.221316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ee0f8-642c-4ddf-aae7-5d86a7f34eeb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:18.319209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ee0f8-642c-4ddf-aae7-5d86a7f34eeb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:18.327512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:18.356433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1158c-2f24-49ea-8b00-50ab36b1b96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:18.357034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1158c-2f24-49ea-8b00-50ab36b1b96c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:18.357315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1158c-2f24-49ea-8b00-50ab36b1b96c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:18.357589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1158c-2f24-49ea-8b00-50ab36b1b96c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:18.422607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1158c-2f24-49ea-8b00-50ab36b1b96c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:18.424040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1158c-2f24-49ea-8b00-50ab36b1b96c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:18.518804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 560/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 12:00:18.525224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a0324-bf05-40f1-a0f3-6e40f1ff2df8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:18.621683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a0324-bf05-40f1-a0f3-6e40f1ff2df8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:18.636634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:18.656401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361a40-31c8-4f4a-8c5e-0521c529d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:18.657022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361a40-31c8-4f4a-8c5e-0521c529d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:18.657302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361a40-31c8-4f4a-8c5e-0521c529d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:18.657581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361a40-31c8-4f4a-8c5e-0521c529d7b9 None admin] PATH_INFO: `/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:18.658720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc361a40-31c8-4f4a-8c5e-0521c529d7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7df2ad43b44f36a6b16e2e2a87a2d0)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:18.660154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc361a40-31c8-4f4a-8c5e-0521c529d7b9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:18.661809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 556/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:18 2022] GET /identity/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:18.668573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1158c-2f24-49ea-8b00-50ab36b1b96c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:18.676625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:18.764768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1158c-2f24-49ea-8b00-50ab36b1b96c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:18.797639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5603d-5aa2-4308-aebc-a8cedd4ac658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:18.798188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5603d-5aa2-4308-aebc-a8cedd4ac658 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:18.798470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5603d-5aa2-4308-aebc-a8cedd4ac658 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:18.798747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5603d-5aa2-4308-aebc-a8cedd4ac658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:18.799458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5603d-5aa2-4308-aebc-a8cedd4ac658 None admin] RBAC: Adding query filter params (role.id=c59031d5db354a478ab7a9ac0000e098, scope.project.id=8c7df2ad43b44f36a6b16e2e2a87a2d0, user.id=c8dd703e2ba04d299d5ae43d132f11a5) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:18.799774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5603d-5aa2-4308-aebc-a8cedd4ac658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:18.801191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5603d-5aa2-4308-aebc-a8cedd4ac658 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:18.807121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 561/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:00:18 2022] GET /identity/v3/role_assignments?user.id=c8dd703e2ba04d299d5ae43d132f11a5&scope.project.id=8c7df2ad43b44f36a6b16e2e2a87a2d0&role.id=c59031d5db354a478ab7a9ac0000e098 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:20.913015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a6a62-be40-4459-86c1-9ecaec8f22f3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:20.913594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a6a62-be40-4459-86c1-9ecaec8f22f3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:20.913594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a6a62-be40-4459-86c1-9ecaec8f22f3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:20.914957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 557/1118] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:20.920740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde92faf-220e-4523-95c4-812106a93528 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:20.921188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde92faf-220e-4523-95c4-812106a93528 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:20.921300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde92faf-220e-4523-95c4-812106a93528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:20.938860 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fde92faf-220e-4523-95c4-812106a93528 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:20.939963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fde92faf-220e-4523-95c4-812106a93528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:20.998968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:21.003666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 562/1119] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:21.276950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a6a62-be40-4459-86c1-9ecaec8f22f3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:21.379184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a6a62-be40-4459-86c1-9ecaec8f22f3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:21.411917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9d21c-80b9-4b3b-8b55-f95814e5725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:21.412535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d21c-80b9-4b3b-8b55-f95814e5725f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:21.412811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d21c-80b9-4b3b-8b55-f95814e5725f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:21.413081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d21c-80b9-4b3b-8b55-f95814e5725f None admin] PATH_INFO: `/v3/roles/c59031d5db354a478ab7a9ac0000e098` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:21.414471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9d21c-80b9-4b3b-8b55-f95814e5725f None admin] RBAC: Authorizing `identity:get_role(role_id=c59031d5db354a478ab7a9ac0000e098)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:21.416412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9d21c-80b9-4b3b-8b55-f95814e5725f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:21.417738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 558/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:21 2022] GET /identity/v3/roles/c59031d5db354a478ab7a9ac0000e098 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:21.423534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde92faf-220e-4523-95c4-812106a93528 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:21.517844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde92faf-220e-4523-95c4-812106a93528 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:21.549982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8140a08-2f68-4f03-a3b4-34dfa253ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:21.550537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8140a08-2f68-4f03-a3b4-34dfa253ac70 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:21.550813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8140a08-2f68-4f03-a3b4-34dfa253ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:21.551084 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8140a08-2f68-4f03-a3b4-34dfa253ac70 None admin] PATH_INFO: `/v3/users/c8dd703e2ba04d299d5ae43d132f11a5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:21.552171 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8140a08-2f68-4f03-a3b4-34dfa253ac70 None admin] RBAC: Authorizing `identity:get_user(user_id=c8dd703e2ba04d299d5ae43d132f11a5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:21.553577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8140a08-2f68-4f03-a3b4-34dfa253ac70 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:21.555140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 563/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:21 2022] GET /identity/v3/users/c8dd703e2ba04d299d5ae43d132f11a5 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:21.561720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9d21c-80b9-4b3b-8b55-f95814e5725f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:21.609898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:21.657322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9d21c-80b9-4b3b-8b55-f95814e5725f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:21.691445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73ba37-2322-4a3e-8c27-a00f3cf6078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:21.692070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73ba37-2322-4a3e-8c27-a00f3cf6078b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:21.692346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73ba37-2322-4a3e-8c27-a00f3cf6078b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:21.692615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73ba37-2322-4a3e-8c27-a00f3cf6078b None admin] PATH_INFO: `/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:21.693733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73ba37-2322-4a3e-8c27-a00f3cf6078b None admin] RBAC: Authorizing `identity:get_project(project_id=8c7df2ad43b44f36a6b16e2e2a87a2d0)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:21.695164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73ba37-2322-4a3e-8c27-a00f3cf6078b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:21.696893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 559/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:21 2022] GET /identity/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:21.702815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8140a08-2f68-4f03-a3b4-34dfa253ac70 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:21.766880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:21.799504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8140a08-2f68-4f03-a3b4-34dfa253ac70 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:21.832067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20db61-3196-47ff-a579-a69cbf6b0f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:21.832711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20db61-3196-47ff-a579-a69cbf6b0f71 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:21.832994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20db61-3196-47ff-a579-a69cbf6b0f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:21.833270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20db61-3196-47ff-a579-a69cbf6b0f71 None admin] PATH_INFO: `/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0/users/c8dd703e2ba04d299d5ae43d132f11a5/roles/c59031d5db354a478ab7a9ac0000e098` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:21.835418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20db61-3196-47ff-a579-a69cbf6b0f71 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c7df2ad43b44f36a6b16e2e2a87a2d0, user_id=c8dd703e2ba04d299d5ae43d132f11a5, role_id=c59031d5db354a478ab7a9ac0000e098)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:21.836945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20db61-3196-47ff-a579-a69cbf6b0f71 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:21.849183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 564/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 12:00:21 2022] PUT /identity/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0/users/c8dd703e2ba04d299d5ae43d132f11a5/roles/c59031d5db354a478ab7a9ac0000e098 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:00:23.967568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c6564-d72e-4611-ae5b-a1f505139589 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:23.968079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c6564-d72e-4611-ae5b-a1f505139589 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:23.968079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c6564-d72e-4611-ae5b-a1f505139589 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:23.969403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 560/1124] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 12:00:23.974783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2ab0f-fbe1-46a1-80e4-d729cba27fdd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:23.975218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2ab0f-fbe1-46a1-80e4-d729cba27fdd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:23.975312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2ab0f-fbe1-46a1-80e4-d729cba27fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:23.994913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4bb2ab0f-fbe1-46a1-80e4-d729cba27fdd None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:23.996085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4bb2ab0f-fbe1-46a1-80e4-d729cba27fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:24.059442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 565/1125] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:24.324061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c6564-d72e-4611-ae5b-a1f505139589 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:24.421462 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c6564-d72e-4611-ae5b-a1f505139589 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:24.437861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:24.454021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0148e-019f-4d19-9848-2af8e76489b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:24.454630 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0148e-019f-4d19-9848-2af8e76489b0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:24.454905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0148e-019f-4d19-9848-2af8e76489b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:24.455170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0148e-019f-4d19-9848-2af8e76489b0 None admin] PATH_INFO: `/v3/roles/c59031d5db354a478ab7a9ac0000e098` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:24.456528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0148e-019f-4d19-9848-2af8e76489b0 None admin] RBAC: Authorizing `identity:get_role(role_id=c59031d5db354a478ab7a9ac0000e098)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:24.457908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0148e-019f-4d19-9848-2af8e76489b0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:24.459192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 561/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:24 2022] GET /identity/v3/roles/c59031d5db354a478ab7a9ac0000e098 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:24.465560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2ab0f-fbe1-46a1-80e4-d729cba27fdd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:24.520689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:24.560945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2ab0f-fbe1-46a1-80e4-d729cba27fdd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:24.595085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a02ff-b853-4ca9-b905-55c92185a469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:24.595652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a02ff-b853-4ca9-b905-55c92185a469 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:24.595933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a02ff-b853-4ca9-b905-55c92185a469 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:24.596205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a02ff-b853-4ca9-b905-55c92185a469 None admin] PATH_INFO: `/v3/users/c8dd703e2ba04d299d5ae43d132f11a5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:24.597323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a02ff-b853-4ca9-b905-55c92185a469 None admin] RBAC: Authorizing `identity:get_user(user_id=c8dd703e2ba04d299d5ae43d132f11a5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:24.599043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a02ff-b853-4ca9-b905-55c92185a469 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:24.600598 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 566/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:24 2022] GET /identity/v3/users/c8dd703e2ba04d299d5ae43d132f11a5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:24.606467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0148e-019f-4d19-9848-2af8e76489b0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:24.703534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0148e-019f-4d19-9848-2af8e76489b0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:24.736172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b36aee-4cad-4614-8b72-095aca8e33c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:24.736763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b36aee-4cad-4614-8b72-095aca8e33c2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:24.737041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b36aee-4cad-4614-8b72-095aca8e33c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:24.737313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b36aee-4cad-4614-8b72-095aca8e33c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:24.788495 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:24.801713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b36aee-4cad-4614-8b72-095aca8e33c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:24.803146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b36aee-4cad-4614-8b72-095aca8e33c2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:24.898214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 562/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 12:00:24.904270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a02ff-b853-4ca9-b905-55c92185a469 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:24.999509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a02ff-b853-4ca9-b905-55c92185a469 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:25.024081 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:25.032768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2c5b-e632-4b3d-955f-a068a64caf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:25.033380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2c5b-e632-4b3d-955f-a068a64caf91 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:25.033682 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2c5b-e632-4b3d-955f-a068a64caf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:25.033958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2c5b-e632-4b3d-955f-a068a64caf91 None admin] PATH_INFO: `/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:25.035061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc2c5b-e632-4b3d-955f-a068a64caf91 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7df2ad43b44f36a6b16e2e2a87a2d0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:25.036476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc2c5b-e632-4b3d-955f-a068a64caf91 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:25.038102 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 567/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:24 2022] GET /identity/v3/projects/8c7df2ad43b44f36a6b16e2e2a87a2d0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:25.044368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b36aee-4cad-4614-8b72-095aca8e33c2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:25.126404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:25.141464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b36aee-4cad-4614-8b72-095aca8e33c2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:25.173479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94225830-bb16-4c22-89c1-226fd2ae03a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:25.174032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94225830-bb16-4c22-89c1-226fd2ae03a5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:25.174305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94225830-bb16-4c22-89c1-226fd2ae03a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:25.174572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94225830-bb16-4c22-89c1-226fd2ae03a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:25.175274 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94225830-bb16-4c22-89c1-226fd2ae03a5 None admin] RBAC: Adding query filter params (role.id=c59031d5db354a478ab7a9ac0000e098, scope.project.id=8c7df2ad43b44f36a6b16e2e2a87a2d0, user.id=c8dd703e2ba04d299d5ae43d132f11a5) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:25.175580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94225830-bb16-4c22-89c1-226fd2ae03a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:25.176983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94225830-bb16-4c22-89c1-226fd2ae03a5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:25.183024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 563/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:00:25 2022] GET /identity/v3/role_assignments?user.id=c8dd703e2ba04d299d5ae43d132f11a5&scope.project.id=8c7df2ad43b44f36a6b16e2e2a87a2d0&role.id=c59031d5db354a478ab7a9ac0000e098 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:27.330848 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79293d-d1bb-4618-a20a-8d947de9c817 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:27.331409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79293d-d1bb-4618-a20a-8d947de9c817 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:27.331409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79293d-d1bb-4618-a20a-8d947de9c817 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:27.332708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 568/1131] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:27.338023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d8532-c1a3-43aa-9cf6-75b657a384ab None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:27.338466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d8532-c1a3-43aa-9cf6-75b657a384ab None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:27.338559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d8532-c1a3-43aa-9cf6-75b657a384ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:27.356521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e88d8532-c1a3-43aa-9cf6-75b657a384ab None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:27.358008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e88d8532-c1a3-43aa-9cf6-75b657a384ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:27.421741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 564/1132] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:27.694268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79293d-d1bb-4618-a20a-8d947de9c817 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:27.792307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79293d-d1bb-4618-a20a-8d947de9c817 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:27.824129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc69be-5fa4-453c-a537-327354a39b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:27.824736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc69be-5fa4-453c-a537-327354a39b7c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:27.825010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc69be-5fa4-453c-a537-327354a39b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:27.825279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc69be-5fa4-453c-a537-327354a39b7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:27.826378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc69be-5fa4-453c-a537-327354a39b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:27.827787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc69be-5fa4-453c-a537-327354a39b7c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:27.829309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 569/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:27.834982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d8532-c1a3-43aa-9cf6-75b657a384ab None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:27.911890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:27.930956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d8532-c1a3-43aa-9cf6-75b657a384ab None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:27.963283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c4ef7-0851-4698-9ac9-c1bc9d3b167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:27.963869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c4ef7-0851-4698-9ac9-c1bc9d3b167a None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:27.964147 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c4ef7-0851-4698-9ac9-c1bc9d3b167a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:27.964418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c4ef7-0851-4698-9ac9-c1bc9d3b167a None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:27.965061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c4ef7-0851-4698-9ac9-c1bc9d3b167a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:27.966510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c4ef7-0851-4698-9ac9-c1bc9d3b167a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:27.992513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 565/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 12:00:27 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:00:30.147474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2c52-56f0-444f-8221-9811bbe1c9ee None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:30.148004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2c52-56f0-444f-8221-9811bbe1c9ee None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:30.148004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2c52-56f0-444f-8221-9811bbe1c9ee None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:30.150008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 570/1135] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:30.155360 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05e7bd-ae8a-45d3-98d5-5cb13030584c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:30.155755 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05e7bd-ae8a-45d3-98d5-5cb13030584c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:30.155914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05e7bd-ae8a-45d3-98d5-5cb13030584c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:30.174736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5a05e7bd-ae8a-45d3-98d5-5cb13030584c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:30.175919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5a05e7bd-ae8a-45d3-98d5-5cb13030584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:30.243221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 566/1136] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:30.511011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb2c52-56f0-444f-8221-9811bbe1c9ee None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:30.574491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:30.613956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb2c52-56f0-444f-8221-9811bbe1c9ee None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:30.646815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be28b2e-0c42-4f19-babc-ccb7bc0bbf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:30.647432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be28b2e-0c42-4f19-babc-ccb7bc0bbf70 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:30.647715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be28b2e-0c42-4f19-babc-ccb7bc0bbf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:30.647989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be28b2e-0c42-4f19-babc-ccb7bc0bbf70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:30.649678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be28b2e-0c42-4f19-babc-ccb7bc0bbf70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:30.651109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be28b2e-0c42-4f19-babc-ccb7bc0bbf70 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:30.652659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 571/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:00:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:30.658359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05e7bd-ae8a-45d3-98d5-5cb13030584c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:30.716989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:30.754084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05e7bd-ae8a-45d3-98d5-5cb13030584c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:30.786792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6de7ac-c8d3-4941-93f7-38ff53fcba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:30.787322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6de7ac-c8d3-4941-93f7-38ff53fcba47 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:30.787597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6de7ac-c8d3-4941-93f7-38ff53fcba47 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:30.787867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6de7ac-c8d3-4941-93f7-38ff53fcba47 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:30.788514 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6de7ac-c8d3-4941-93f7-38ff53fcba47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:30.789988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6de7ac-c8d3-4941-93f7-38ff53fcba47 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:30.809784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 567/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 12:00:30 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:00:33.018963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51851c-4696-48e1-a874-bf9949c22c19 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:33.019480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51851c-4696-48e1-a874-bf9949c22c19 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:33.019480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51851c-4696-48e1-a874-bf9949c22c19 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:33.020733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 572/1139] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:33.026468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90129e41-d7ce-415c-8e5e-99ba66f82563 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:33.026885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90129e41-d7ce-415c-8e5e-99ba66f82563 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:33.027021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90129e41-d7ce-415c-8e5e-99ba66f82563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:33.045128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-90129e41-d7ce-415c-8e5e-99ba66f82563 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:33.046336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-90129e41-d7ce-415c-8e5e-99ba66f82563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:33.109735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 568/1140] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:33.384488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51851c-4696-48e1-a874-bf9949c22c19 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:33.481185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51851c-4696-48e1-a874-bf9949c22c19 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:33.508239 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:33.514526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1162a-1765-416e-ac1b-36e005bd67ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:33.515147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1162a-1765-416e-ac1b-36e005bd67ab None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:33.515427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1162a-1765-416e-ac1b-36e005bd67ab None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:33.515697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1162a-1765-416e-ac1b-36e005bd67ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:33.525603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1162a-1765-416e-ac1b-36e005bd67ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1eb1162a-1765-416e-ac1b-36e005bd67ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:33.530368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:33.531433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:33.532550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 573/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:00:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:33.537472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90129e41-d7ce-415c-8e5e-99ba66f82563 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:33.585714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:33.635471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90129e41-d7ce-415c-8e5e-99ba66f82563 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:33.667855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af6ebd-d82d-4f0d-b785-5c25d96edf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:33.668460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af6ebd-d82d-4f0d-b785-5c25d96edf49 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:33.668737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af6ebd-d82d-4f0d-b785-5c25d96edf49 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:33.669013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af6ebd-d82d-4f0d-b785-5c25d96edf49 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:33.669707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af6ebd-d82d-4f0d-b785-5c25d96edf49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:33.670014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af6ebd-d82d-4f0d-b785-5c25d96edf49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:33.671375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af6ebd-d82d-4f0d-b785-5c25d96edf49 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:33.679398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 569/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:33.685906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1162a-1765-416e-ac1b-36e005bd67ab None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:33.782842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1162a-1765-416e-ac1b-36e005bd67ab None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:33.815662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aae84-5c10-44f9-a56f-c79ff02664b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:33.816271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aae84-5c10-44f9-a56f-c79ff02664b8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:33.816551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aae84-5c10-44f9-a56f-c79ff02664b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:33.816827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aae84-5c10-44f9-a56f-c79ff02664b8 None admin] PATH_INFO: `/v3/users/1d03378b09ea4dff909a85f7012e7eab` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:33.829785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692aae84-5c10-44f9-a56f-c79ff02664b8 None admin] RBAC: Authorizing `identity:get_user(user_id=1d03378b09ea4dff909a85f7012e7eab)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:33.831213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692aae84-5c10-44f9-a56f-c79ff02664b8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:33.832763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 574/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:33 2022] GET /identity/v3/users/1d03378b09ea4dff909a85f7012e7eab => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:33.838528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af6ebd-d82d-4f0d-b785-5c25d96edf49 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:33.935463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af6ebd-d82d-4f0d-b785-5c25d96edf49 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:33.945103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:33.968207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63597b-5fdc-4cf8-abbb-cba60785a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:33.968797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63597b-5fdc-4cf8-abbb-cba60785a503 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:33.969075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63597b-5fdc-4cf8-abbb-cba60785a503 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:33.969353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63597b-5fdc-4cf8-abbb-cba60785a503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:34.033052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63597b-5fdc-4cf8-abbb-cba60785a503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:34.034510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63597b-5fdc-4cf8-abbb-cba60785a503 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:34.129793 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 570/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 12:00:34.136477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aae84-5c10-44f9-a56f-c79ff02664b8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:34.183299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:34.233426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aae84-5c10-44f9-a56f-c79ff02664b8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:34.266026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba64af0-7939-489e-8fa9-20ed62894898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:34.266646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba64af0-7939-489e-8fa9-20ed62894898 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:34.266924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba64af0-7939-489e-8fa9-20ed62894898 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:34.267195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba64af0-7939-489e-8fa9-20ed62894898 None admin] PATH_INFO: `/v3/projects/dbd528fee35a4446a66be99b42495bd4` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:34.268286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba64af0-7939-489e-8fa9-20ed62894898 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd528fee35a4446a66be99b42495bd4)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:34.269716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba64af0-7939-489e-8fa9-20ed62894898 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:34.271302 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 575/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:34 2022] GET /identity/v3/projects/dbd528fee35a4446a66be99b42495bd4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:34.277460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63597b-5fdc-4cf8-abbb-cba60785a503 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:34.288613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:34.373761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63597b-5fdc-4cf8-abbb-cba60785a503 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:34.406074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e7f13-9a06-4878-ae7b-8e7d6e355d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:34.406660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7f13-9a06-4878-ae7b-8e7d6e355d52 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:34.406933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7f13-9a06-4878-ae7b-8e7d6e355d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:34.407206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7f13-9a06-4878-ae7b-8e7d6e355d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:34.407905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e7f13-9a06-4878-ae7b-8e7d6e355d52 None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=dbd528fee35a4446a66be99b42495bd4, user.id=1d03378b09ea4dff909a85f7012e7eab) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:34.408237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e7f13-9a06-4878-ae7b-8e7d6e355d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:34.409655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e7f13-9a06-4878-ae7b-8e7d6e355d52 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:34.415376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 571/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:00:34 2022] GET /identity/v3/role_assignments?user.id=1d03378b09ea4dff909a85f7012e7eab&scope.project.id=dbd528fee35a4446a66be99b42495bd4&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:36.501761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5202-2f78-4a11-83bd-ee33476ea426 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:36.502318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5202-2f78-4a11-83bd-ee33476ea426 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:36.502318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db5202-2f78-4a11-83bd-ee33476ea426 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:36.503624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 576/1147] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:36.509302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e662a9-123a-4e20-806a-bfa18a58ac72 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:36.509757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e662a9-123a-4e20-806a-bfa18a58ac72 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:36.509867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e662a9-123a-4e20-806a-bfa18a58ac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:36.527364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-40e662a9-123a-4e20-806a-bfa18a58ac72 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:36.528530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-40e662a9-123a-4e20-806a-bfa18a58ac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:36.592407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 572/1148] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:36.860223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db5202-2f78-4a11-83bd-ee33476ea426 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:36.957740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db5202-2f78-4a11-83bd-ee33476ea426 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:36.972957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:36.991070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2fef-6411-4d1e-971f-a3c0aa485633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:36.991688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2fef-6411-4d1e-971f-a3c0aa485633 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:36.991963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2fef-6411-4d1e-971f-a3c0aa485633 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:36.992233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2fef-6411-4d1e-971f-a3c0aa485633 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:37.002405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c2fef-6411-4d1e-971f-a3c0aa485633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d47c2fef-6411-4d1e-971f-a3c0aa485633 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:37.007117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:37.008840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:37.009956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 577/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:37.014776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e662a9-123a-4e20-806a-bfa18a58ac72 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:37.017782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:37.109299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e662a9-123a-4e20-806a-bfa18a58ac72 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:37.142900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd12d75-429d-4633-8ae4-c624ba6cdc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:37.143436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd12d75-429d-4633-8ae4-c624ba6cdc53 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:37.143714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd12d75-429d-4633-8ae4-c624ba6cdc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:37.143986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd12d75-429d-4633-8ae4-c624ba6cdc53 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:37.144639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd12d75-429d-4633-8ae4-c624ba6cdc53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:37.144941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd12d75-429d-4633-8ae4-c624ba6cdc53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:37.146327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd12d75-429d-4633-8ae4-c624ba6cdc53 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:37.154762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 573/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:00:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:37.160461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2fef-6411-4d1e-971f-a3c0aa485633 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:37.256502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2fef-6411-4d1e-971f-a3c0aa485633 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:37.289222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73c015-13f5-4711-a391-dcb5185781e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:37.290389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73c015-13f5-4711-a391-dcb5185781e1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:37.290663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73c015-13f5-4711-a391-dcb5185781e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:37.290933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73c015-13f5-4711-a391-dcb5185781e1 None admin] PATH_INFO: `/v3/users/1d03378b09ea4dff909a85f7012e7eab` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:37.292033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73c015-13f5-4711-a391-dcb5185781e1 None admin] RBAC: Authorizing `identity:get_user(user_id=1d03378b09ea4dff909a85f7012e7eab)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:37.293447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73c015-13f5-4711-a391-dcb5185781e1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:37.295017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 578/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:37 2022] GET /identity/v3/users/1d03378b09ea4dff909a85f7012e7eab => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:37.300512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd12d75-429d-4633-8ae4-c624ba6cdc53 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:37.364031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:37.397776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd12d75-429d-4633-8ae4-c624ba6cdc53 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:37.429192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea155e72-b201-4af6-99de-68dc2f055467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:37.429833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155e72-b201-4af6-99de-68dc2f055467 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:37.430724 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155e72-b201-4af6-99de-68dc2f055467 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:37.431007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155e72-b201-4af6-99de-68dc2f055467 None admin] PATH_INFO: `/v3/projects/dbd528fee35a4446a66be99b42495bd4` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:37.432107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea155e72-b201-4af6-99de-68dc2f055467 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd528fee35a4446a66be99b42495bd4)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:37.433514 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea155e72-b201-4af6-99de-68dc2f055467 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:37.435141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 574/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:37 2022] GET /identity/v3/projects/dbd528fee35a4446a66be99b42495bd4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:37.440968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73c015-13f5-4711-a391-dcb5185781e1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:37.484923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:37.535580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73c015-13f5-4711-a391-dcb5185781e1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:37.568575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794bd43-c3b0-426f-83fc-3c93c176ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:37.569209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794bd43-c3b0-426f-83fc-3c93c176ee48 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:37.569483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794bd43-c3b0-426f-83fc-3c93c176ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:37.569792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794bd43-c3b0-426f-83fc-3c93c176ee48 None admin] PATH_INFO: `/v3/projects/dbd528fee35a4446a66be99b42495bd4/users/1d03378b09ea4dff909a85f7012e7eab/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:37.571732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794bd43-c3b0-426f-83fc-3c93c176ee48 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbd528fee35a4446a66be99b42495bd4, user_id=1d03378b09ea4dff909a85f7012e7eab, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:37.573412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794bd43-c3b0-426f-83fc-3c93c176ee48 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:37.585440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 579/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 12:00:37 2022] PUT /identity/v3/projects/dbd528fee35a4446a66be99b42495bd4/users/1d03378b09ea4dff909a85f7012e7eab/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:00:39.704318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f13b0c-8c3e-4d4f-859d-62638bd33ad6 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:39.704793 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f13b0c-8c3e-4d4f-859d-62638bd33ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:39.704907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f13b0c-8c3e-4d4f-859d-62638bd33ad6 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:39.706236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 575/1154] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:39.711343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf438cc3-8ba7-4a20-b0bc-e07a1976522b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:39.711805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf438cc3-8ba7-4a20-b0bc-e07a1976522b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:39.712195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf438cc3-8ba7-4a20-b0bc-e07a1976522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:39.730626 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bf438cc3-8ba7-4a20-b0bc-e07a1976522b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:39.731802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bf438cc3-8ba7-4a20-b0bc-e07a1976522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:39.796179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 580/1155] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:40.064693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f13b0c-8c3e-4d4f-859d-62638bd33ad6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:40.161717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f13b0c-8c3e-4d4f-859d-62638bd33ad6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:40.193749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a8eeb-fddb-463b-a74e-54aa776c535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:40.194366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a8eeb-fddb-463b-a74e-54aa776c535b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:40.194644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a8eeb-fddb-463b-a74e-54aa776c535b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:40.194917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a8eeb-fddb-463b-a74e-54aa776c535b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:40.197470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:40.206843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a8eeb-fddb-463b-a74e-54aa776c535b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-174a8eeb-fddb-463b-a74e-54aa776c535b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:40.211662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:40.212727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:40.213962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 576/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:40.218787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf438cc3-8ba7-4a20-b0bc-e07a1976522b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:40.251013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:40.316704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf438cc3-8ba7-4a20-b0bc-e07a1976522b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:40.349282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9de87c-bec5-4af4-b312-1f1985f49f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:40.349903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9de87c-bec5-4af4-b312-1f1985f49f33 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:40.350186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9de87c-bec5-4af4-b312-1f1985f49f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:40.350460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9de87c-bec5-4af4-b312-1f1985f49f33 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:40.351118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9de87c-bec5-4af4-b312-1f1985f49f33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:40.351423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9de87c-bec5-4af4-b312-1f1985f49f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:40.353392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9de87c-bec5-4af4-b312-1f1985f49f33 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:40.361128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 581/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:40.367183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a8eeb-fddb-463b-a74e-54aa776c535b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:40.463904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a8eeb-fddb-463b-a74e-54aa776c535b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:40.497004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e1bd2-cb9c-4110-b592-a6cfb90aa18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:40.497644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e1bd2-cb9c-4110-b592-a6cfb90aa18b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:40.497924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e1bd2-cb9c-4110-b592-a6cfb90aa18b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:40.498198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e1bd2-cb9c-4110-b592-a6cfb90aa18b None admin] PATH_INFO: `/v3/users/1d03378b09ea4dff909a85f7012e7eab` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:40.499307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e1bd2-cb9c-4110-b592-a6cfb90aa18b None admin] RBAC: Authorizing `identity:get_user(user_id=1d03378b09ea4dff909a85f7012e7eab)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:40.500723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e1bd2-cb9c-4110-b592-a6cfb90aa18b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:40.502304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 577/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:40 2022] GET /identity/v3/users/1d03378b09ea4dff909a85f7012e7eab => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:40.507897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9de87c-bec5-4af4-b312-1f1985f49f33 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:40.598885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:40.605717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9de87c-bec5-4af4-b312-1f1985f49f33 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:40.638091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163f284-6504-41fd-b88a-f577b8663f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:40.638687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163f284-6504-41fd-b88a-f577b8663f1f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:40.638966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163f284-6504-41fd-b88a-f577b8663f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:40.639238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163f284-6504-41fd-b88a-f577b8663f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:40.703488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163f284-6504-41fd-b88a-f577b8663f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:40.704916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163f284-6504-41fd-b88a-f577b8663f1f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:40.792043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:40.798835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 582/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 12:00:40.804721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e1bd2-cb9c-4110-b592-a6cfb90aa18b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:40.863757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:40.902659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e1bd2-cb9c-4110-b592-a6cfb90aa18b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:40.935746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635b994-395a-4eda-b7cb-4e516e256f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:40.936369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b994-395a-4eda-b7cb-4e516e256f45 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:40.936652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b994-395a-4eda-b7cb-4e516e256f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:40.936932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b994-395a-4eda-b7cb-4e516e256f45 None admin] PATH_INFO: `/v3/projects/dbd528fee35a4446a66be99b42495bd4` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:40.938062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635b994-395a-4eda-b7cb-4e516e256f45 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd528fee35a4446a66be99b42495bd4)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:40.939497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635b994-395a-4eda-b7cb-4e516e256f45 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:40.941112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 578/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:40 2022] GET /identity/v3/projects/dbd528fee35a4446a66be99b42495bd4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:40.947350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163f284-6504-41fd-b88a-f577b8663f1f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:41.043641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163f284-6504-41fd-b88a-f577b8663f1f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:41.076585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc3ca7-16fd-4aac-92f0-ccda7113300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:41.077175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc3ca7-16fd-4aac-92f0-ccda7113300c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:41.077458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc3ca7-16fd-4aac-92f0-ccda7113300c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:41.077763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc3ca7-16fd-4aac-92f0-ccda7113300c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:41.078475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc3ca7-16fd-4aac-92f0-ccda7113300c None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=dbd528fee35a4446a66be99b42495bd4, user.id=1d03378b09ea4dff909a85f7012e7eab) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:41.078787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc3ca7-16fd-4aac-92f0-ccda7113300c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:41.080209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc3ca7-16fd-4aac-92f0-ccda7113300c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:41.085736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 583/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:00:40 2022] GET /identity/v3/role_assignments?user.id=1d03378b09ea4dff909a85f7012e7eab&scope.project.id=dbd528fee35a4446a66be99b42495bd4&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:43.203133 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf03a-18c2-4350-9489-b0a72bfb18b1 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:43.203666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf03a-18c2-4350-9489-b0a72bfb18b1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:43.203666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf03a-18c2-4350-9489-b0a72bfb18b1 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:43.205000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 579/1162] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:43.210244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5418-e5d2-4170-a5e3-6667a585cb37 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:43.210667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5418-e5d2-4170-a5e3-6667a585cb37 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:43.210795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5418-e5d2-4170-a5e3-6667a585cb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:43.230338 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d0dd5418-e5d2-4170-a5e3-6667a585cb37 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:43.231494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d0dd5418-e5d2-4170-a5e3-6667a585cb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:43.283825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:43.295088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 584/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:43.560130 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adf03a-18c2-4350-9489-b0a72bfb18b1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:43.659146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adf03a-18c2-4350-9489-b0a72bfb18b1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:43.686974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:43.693149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba222b-257c-4b66-a691-a750ebc26053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:43.693778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba222b-257c-4b66-a691-a750ebc26053 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:43.694057 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba222b-257c-4b66-a691-a750ebc26053 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:43.694328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba222b-257c-4b66-a691-a750ebc26053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:43.759931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba222b-257c-4b66-a691-a750ebc26053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:43.761371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba222b-257c-4b66-a691-a750ebc26053 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:43.854662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 580/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 12:00:43.860476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd5418-e5d2-4170-a5e3-6667a585cb37 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:43.955881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd5418-e5d2-4170-a5e3-6667a585cb37 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:43.988176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95e0e-e588-4011-8a4a-0f4549c603d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:43.988795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95e0e-e588-4011-8a4a-0f4549c603d3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:43.989077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95e0e-e588-4011-8a4a-0f4549c603d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:43.989352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95e0e-e588-4011-8a4a-0f4549c603d3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:43.996289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95e0e-e588-4011-8a4a-0f4549c603d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:43.997738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95e0e-e588-4011-8a4a-0f4549c603d3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-22f95e0e-e588-4011-8a4a-0f4549c603d3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:44.009482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:44.010680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:00:44.011548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 585/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 19 12:00:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:44.016559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba222b-257c-4b66-a691-a750ebc26053 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:44.045434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:44.112036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba222b-257c-4b66-a691-a750ebc26053 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:44.144459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21f10e-cf5f-40ff-9424-dced4c7cade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:44.145045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21f10e-cf5f-40ff-9424-dced4c7cade1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:44.145320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21f10e-cf5f-40ff-9424-dced4c7cade1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:44.145586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21f10e-cf5f-40ff-9424-dced4c7cade1 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:44.146235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21f10e-cf5f-40ff-9424-dced4c7cade1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:44.146532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21f10e-cf5f-40ff-9424-dced4c7cade1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:44.147875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21f10e-cf5f-40ff-9424-dced4c7cade1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:44.154795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 581/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 19 12:00:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:46.270935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5484a-d1b1-4668-8c8a-871cd8bb1755 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:46.271487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5484a-d1b1-4668-8c8a-871cd8bb1755 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:46.271487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5484a-d1b1-4668-8c8a-871cd8bb1755 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:46.272797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 586/1167] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:46.278145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79e294-129e-4615-b731-ed2b02d60b06 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:46.278548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79e294-129e-4615-b731-ed2b02d60b06 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:46.278726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79e294-129e-4615-b731-ed2b02d60b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:46.297022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2c79e294-129e-4615-b731-ed2b02d60b06 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:46.298236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2c79e294-129e-4615-b731-ed2b02d60b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:46.364144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 582/1168] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:46.635301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5484a-d1b1-4668-8c8a-871cd8bb1755 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:46.687152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:46.737980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5484a-d1b1-4668-8c8a-871cd8bb1755 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:46.769831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a1e85-9a7f-4ec9-8242-70baa9ba2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:46.770428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a1e85-9a7f-4ec9-8242-70baa9ba2fcc None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:46.770706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a1e85-9a7f-4ec9-8242-70baa9ba2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:46.770979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a1e85-9a7f-4ec9-8242-70baa9ba2fcc None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:46.771647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a1e85-9a7f-4ec9-8242-70baa9ba2fcc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:46.772988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a1e85-9a7f-4ec9-8242-70baa9ba2fcc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:46.788543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 587/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Mon Sep 19 12:00:46 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:00:48.974196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8db04-1e73-45f2-908d-f1ca031ab83d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:48.974709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8db04-1e73-45f2-908d-f1ca031ab83d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:48.974709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8db04-1e73-45f2-908d-f1ca031ab83d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:48.975994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 583/1170] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:48.982062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c29c-1c88-49a6-adf3-eddfb68ebf79 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:48.982460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c29c-1c88-49a6-adf3-eddfb68ebf79 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:48.982616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c29c-1c88-49a6-adf3-eddfb68ebf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:49.000304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4e22c29c-1c88-49a6-adf3-eddfb68ebf79 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:49.001477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4e22c29c-1c88-49a6-adf3-eddfb68ebf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:49.064230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 588/1171] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:49.333576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8db04-1e73-45f2-908d-f1ca031ab83d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:49.358862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:49.433013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8db04-1e73-45f2-908d-f1ca031ab83d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:49.465066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ec110-deb9-4fd7-8fb3-77a1ad4536da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:49.465706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ec110-deb9-4fd7-8fb3-77a1ad4536da None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:49.465990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ec110-deb9-4fd7-8fb3-77a1ad4536da None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:49.466264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ec110-deb9-4fd7-8fb3-77a1ad4536da None admin] PATH_INFO: `/v3/domains/99a8c751e9f8430191292071d4b5579b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:49.476376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ec110-deb9-4fd7-8fb3-77a1ad4536da None admin] RBAC: Authorizing `identity:get_domain(domain_id=99a8c751e9f8430191292071d4b5579b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:49.478840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ec110-deb9-4fd7-8fb3-77a1ad4536da None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:49.480401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 584/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Mon Sep 19 12:00:49 2022] GET /identity/v3/domains/99a8c751e9f8430191292071d4b5579b => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:49.486160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c29c-1c88-49a6-adf3-eddfb68ebf79 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:49.525394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:49.580178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c29c-1c88-49a6-adf3-eddfb68ebf79 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:49.612745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77fa0f-d37f-4842-9f3c-d3cccfd005cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:49.613273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77fa0f-d37f-4842-9f3c-d3cccfd005cf None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:49.613547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77fa0f-d37f-4842-9f3c-d3cccfd005cf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:49.613842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77fa0f-d37f-4842-9f3c-d3cccfd005cf None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:49.614475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77fa0f-d37f-4842-9f3c-d3cccfd005cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:49.615887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77fa0f-d37f-4842-9f3c-d3cccfd005cf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:49.640636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 589/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 12:00:49 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:00:51.796608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64be2a5-8aec-4881-a903-253573f1aefe None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:51.797122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64be2a5-8aec-4881-a903-253573f1aefe None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:51.797234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64be2a5-8aec-4881-a903-253573f1aefe None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:51.798513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 585/1174] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:51.803834 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1910b-cceb-4f92-b34d-b3eb1d507414 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:51.804251 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1910b-cceb-4f92-b34d-b3eb1d507414 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:51.804473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1910b-cceb-4f92-b34d-b3eb1d507414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:51.823727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c8c1910b-cceb-4f92-b34d-b3eb1d507414 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:51.824908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c8c1910b-cceb-4f92-b34d-b3eb1d507414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:51.889013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 590/1175] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:52.157872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64be2a5-8aec-4881-a903-253573f1aefe None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:52.244483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:52.261406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64be2a5-8aec-4881-a903-253573f1aefe None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:52.293701 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320f116-6e9c-4f36-8c9d-4199dc70e002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:52.294316 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320f116-6e9c-4f36-8c9d-4199dc70e002 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:52.294597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320f116-6e9c-4f36-8c9d-4199dc70e002 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:52.294868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320f116-6e9c-4f36-8c9d-4199dc70e002 None admin] PATH_INFO: `/v3/domains/99a8c751e9f8430191292071d4b5579b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:52.295969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320f116-6e9c-4f36-8c9d-4199dc70e002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=99a8c751e9f8430191292071d4b5579b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:52.297398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320f116-6e9c-4f36-8c9d-4199dc70e002 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:52.298971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 586/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Mon Sep 19 12:00:52 2022] GET /identity/v3/domains/99a8c751e9f8430191292071d4b5579b => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:52.304665 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1910b-cceb-4f92-b34d-b3eb1d507414 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:52.327561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:52.403908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1910b-cceb-4f92-b34d-b3eb1d507414 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:52.436859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2171b5-be74-493f-9c6f-1b3cdb1ccc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:52.437393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2171b5-be74-493f-9c6f-1b3cdb1ccc7d None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:52.437692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2171b5-be74-493f-9c6f-1b3cdb1ccc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:52.437976 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2171b5-be74-493f-9c6f-1b3cdb1ccc7d None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:52.438620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2171b5-be74-493f-9c6f-1b3cdb1ccc7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:52.440023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2171b5-be74-493f-9c6f-1b3cdb1ccc7d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:52.460355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 591/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 12:00:52 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:00:54.734499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0c20f-a284-47e3-b794-9e2aad391fc0 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:54.735036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0c20f-a284-47e3-b794-9e2aad391fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:54.735036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0c20f-a284-47e3-b794-9e2aad391fc0 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:54.736412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 587/1178] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:54.741703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1716e-d1f0-4a4c-8379-a1985a90d6e8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:54.742082 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1716e-d1f0-4a4c-8379-a1985a90d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:54.742327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1716e-d1f0-4a4c-8379-a1985a90d6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:54.760786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1ac1716e-d1f0-4a4c-8379-a1985a90d6e8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:54.762004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1ac1716e-d1f0-4a4c-8379-a1985a90d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:54.829361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 592/1179] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:00:55.109493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0c20f-a284-47e3-b794-9e2aad391fc0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:55.210439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0c20f-a284-47e3-b794-9e2aad391fc0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:55.241968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c7ced-bc8e-422e-88ea-606e380f9a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:55.243089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c7ced-bc8e-422e-88ea-606e380f9a52 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:55.243358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c7ced-bc8e-422e-88ea-606e380f9a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:55.243623 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c7ced-bc8e-422e-88ea-606e380f9a52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:55.253645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c7ced-bc8e-422e-88ea-606e380f9a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-019c7ced-bc8e-422e-88ea-606e380f9a52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:55.258924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:55.260038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:55.261119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 588/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:55.266139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1716e-d1f0-4a4c-8379-a1985a90d6e8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:55.275888 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:55.362239 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1716e-d1f0-4a4c-8379-a1985a90d6e8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:55.394168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f80d7-a6d8-4b37-8dca-2bec29ce4a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:55.394759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f80d7-a6d8-4b37-8dca-2bec29ce4a5e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:55.395035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f80d7-a6d8-4b37-8dca-2bec29ce4a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:55.395305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f80d7-a6d8-4b37-8dca-2bec29ce4a5e None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:55.395946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f80d7-a6d8-4b37-8dca-2bec29ce4a5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:55.396249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f80d7-a6d8-4b37-8dca-2bec29ce4a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:55.397594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f80d7-a6d8-4b37-8dca-2bec29ce4a5e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:55.406024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 593/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:55.411985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c7ced-bc8e-422e-88ea-606e380f9a52 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:55.426738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:55.514287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c7ced-bc8e-422e-88ea-606e380f9a52 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:55.546488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bc9eb-5220-43e6-9942-c8fcd394282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:55.547104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bc9eb-5220-43e6-9942-c8fcd394282b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:55.547385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bc9eb-5220-43e6-9942-c8fcd394282b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:55.547658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bc9eb-5220-43e6-9942-c8fcd394282b None admin] PATH_INFO: `/v3/users/b3079b76085e4341a607add0aacd43a9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:55.560206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bc9eb-5220-43e6-9942-c8fcd394282b None admin] RBAC: Authorizing `identity:get_user(user_id=b3079b76085e4341a607add0aacd43a9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:55.561641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bc9eb-5220-43e6-9942-c8fcd394282b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:55.563215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 589/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:55 2022] GET /identity/v3/users/b3079b76085e4341a607add0aacd43a9 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:55.569036 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f80d7-a6d8-4b37-8dca-2bec29ce4a5e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:55.636331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:55.666104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f80d7-a6d8-4b37-8dca-2bec29ce4a5e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:55.700228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e56328-8e02-41ea-a7cd-637855f81c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:55.700830 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e56328-8e02-41ea-a7cd-637855f81c3c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:55.701108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e56328-8e02-41ea-a7cd-637855f81c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:55.701377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e56328-8e02-41ea-a7cd-637855f81c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:55.764706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e56328-8e02-41ea-a7cd-637855f81c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:55.766174 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e56328-8e02-41ea-a7cd-637855f81c3c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:55.829174 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:55.860248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 594/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:00:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 12:00:55.866339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bc9eb-5220-43e6-9942-c8fcd394282b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:55.933064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:55.963171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bc9eb-5220-43e6-9942-c8fcd394282b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:55.995616 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefe698-7d82-4b4c-b0e7-964a02850c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:55.996222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefe698-7d82-4b4c-b0e7-964a02850c1a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:55.996496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefe698-7d82-4b4c-b0e7-964a02850c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:55.996765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefe698-7d82-4b4c-b0e7-964a02850c1a None admin] PATH_INFO: `/v3/projects/fe81cdf7934c4e8c9a357d3d6c913022` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:55.997869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefe698-7d82-4b4c-b0e7-964a02850c1a None admin] RBAC: Authorizing `identity:get_project(project_id=fe81cdf7934c4e8c9a357d3d6c913022)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:55.999276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefe698-7d82-4b4c-b0e7-964a02850c1a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:56.000862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 590/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:55 2022] GET /identity/v3/projects/fe81cdf7934c4e8c9a357d3d6c913022 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:56.006990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e56328-8e02-41ea-a7cd-637855f81c3c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:56.101344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e56328-8e02-41ea-a7cd-637855f81c3c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:56.134363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ba63-17f9-4b2b-96cf-531c1f54977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:56.134946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ba63-17f9-4b2b-96cf-531c1f54977a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:56.135221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ba63-17f9-4b2b-96cf-531c1f54977a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:56.135487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ba63-17f9-4b2b-96cf-531c1f54977a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:56.136186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ba63-17f9-4b2b-96cf-531c1f54977a None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=fe81cdf7934c4e8c9a357d3d6c913022, user.id=b3079b76085e4341a607add0aacd43a9) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:56.136489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ba63-17f9-4b2b-96cf-531c1f54977a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:56.137908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ba63-17f9-4b2b-96cf-531c1f54977a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:56.142990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 595/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:00:56 2022] GET /identity/v3/role_assignments?user.id=b3079b76085e4341a607add0aacd43a9&scope.project.id=fe81cdf7934c4e8c9a357d3d6c913022&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:00:58.224678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db4b2d-6607-4e5b-bafc-b41e7df493af None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:58.225228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db4b2d-6607-4e5b-bafc-b41e7df493af None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:58.225228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db4b2d-6607-4e5b-bafc-b41e7df493af None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:58.227170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 591/1186] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:00:58.232385 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342ffd0-023f-402f-bff5-1825d67cf07a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:58.232818 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342ffd0-023f-402f-bff5-1825d67cf07a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:58.232923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342ffd0-023f-402f-bff5-1825d67cf07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:58.250645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b342ffd0-023f-402f-bff5-1825d67cf07a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:58.251806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b342ffd0-023f-402f-bff5-1825d67cf07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:58.277847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:58.315101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 596/1187] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:00:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:00:58.580155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db4b2d-6607-4e5b-bafc-b41e7df493af None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:58.679029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db4b2d-6607-4e5b-bafc-b41e7df493af None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:58.712725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d34c21-951f-4f6a-a625-f7c55317c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:58.713341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34c21-951f-4f6a-a625-f7c55317c9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:58.713641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34c21-951f-4f6a-a625-f7c55317c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:58.713915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34c21-951f-4f6a-a625-f7c55317c9c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:58.720323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:58.724919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d34c21-951f-4f6a-a625-f7c55317c9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-92d34c21-951f-4f6a-a625-f7c55317c9c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:00:58.730471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:00:58.731545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:00:58.732397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 592/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:00:58.737607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342ffd0-023f-402f-bff5-1825d67cf07a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:58.838688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342ffd0-023f-402f-bff5-1825d67cf07a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:58.871080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23701-9cd4-4a54-ae5d-89531d7615d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:58.871672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23701-9cd4-4a54-ae5d-89531d7615d0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:58.871950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23701-9cd4-4a54-ae5d-89531d7615d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:58.872220 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23701-9cd4-4a54-ae5d-89531d7615d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:58.872870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23701-9cd4-4a54-ae5d-89531d7615d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:00:58.873168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23701-9cd4-4a54-ae5d-89531d7615d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:58.874543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23701-9cd4-4a54-ae5d-89531d7615d0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:58.882212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 597/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:58.888582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d34c21-951f-4f6a-a625-f7c55317c9c0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:58.983794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d34c21-951f-4f6a-a625-f7c55317c9c0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:59.016875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c362fe-7805-4d56-885a-1ea54af383a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:59.017490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c362fe-7805-4d56-885a-1ea54af383a4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:59.017794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c362fe-7805-4d56-885a-1ea54af383a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:59.018067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c362fe-7805-4d56-885a-1ea54af383a4 None admin] PATH_INFO: `/v3/users/b3079b76085e4341a607add0aacd43a9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:59.019165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c362fe-7805-4d56-885a-1ea54af383a4 None admin] RBAC: Authorizing `identity:get_user(user_id=b3079b76085e4341a607add0aacd43a9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:59.020585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c362fe-7805-4d56-885a-1ea54af383a4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:59.022158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 593/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:00:58 2022] GET /identity/v3/users/b3079b76085e4341a607add0aacd43a9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:59.027742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23701-9cd4-4a54-ae5d-89531d7615d0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:59.054499 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:59.124645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23701-9cd4-4a54-ae5d-89531d7615d0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:59.157521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21bd37-232f-421f-a169-6450b91aca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:59.158160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bd37-232f-421f-a169-6450b91aca16 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:59.158441 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bd37-232f-421f-a169-6450b91aca16 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:59.158716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bd37-232f-421f-a169-6450b91aca16 None admin] PATH_INFO: `/v3/projects/fe81cdf7934c4e8c9a357d3d6c913022` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:59.159817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21bd37-232f-421f-a169-6450b91aca16 None admin] RBAC: Authorizing `identity:get_project(project_id=fe81cdf7934c4e8c9a357d3d6c913022)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:59.161225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21bd37-232f-421f-a169-6450b91aca16 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:59.162830 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 598/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:00:59 2022] GET /identity/v3/projects/fe81cdf7934c4e8c9a357d3d6c913022 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:00:59.168594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c362fe-7805-4d56-885a-1ea54af383a4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:59.233293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:59.267431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c362fe-7805-4d56-885a-1ea54af383a4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:59.299994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd249dc-4250-472d-b9ac-10cf1b47ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:59.300628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd249dc-4250-472d-b9ac-10cf1b47ba62 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:59.300906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd249dc-4250-472d-b9ac-10cf1b47ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:59.301177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd249dc-4250-472d-b9ac-10cf1b47ba62 None admin] PATH_INFO: `/v3/projects/fe81cdf7934c4e8c9a357d3d6c913022/users/b3079b76085e4341a607add0aacd43a9/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:59.303069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd249dc-4250-472d-b9ac-10cf1b47ba62 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe81cdf7934c4e8c9a357d3d6c913022, user_id=b3079b76085e4341a607add0aacd43a9, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:59.304663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd249dc-4250-472d-b9ac-10cf1b47ba62 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:59.316596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 594/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 12:00:59 2022] PUT /identity/v3/projects/fe81cdf7934c4e8c9a357d3d6c913022/users/b3079b76085e4341a607add0aacd43a9/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:01:01.439236 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015352c4-8777-466a-b512-4784fda1d4a8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:01.439762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015352c4-8777-466a-b512-4784fda1d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:01.439762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015352c4-8777-466a-b512-4784fda1d4a8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:01.441096 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 599/1193] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:01:01.446266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edd776-8631-40a2-a619-8de7e13d0425 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:01.446714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edd776-8631-40a2-a619-8de7e13d0425 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:01.446805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edd776-8631-40a2-a619-8de7e13d0425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:01.464215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f2edd776-8631-40a2-a619-8de7e13d0425 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:01:01.465380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f2edd776-8631-40a2-a619-8de7e13d0425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:01.530764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 595/1194] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:01:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:01:01.798973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015352c4-8777-466a-b512-4784fda1d4a8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:01.893198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:01.901083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015352c4-8777-466a-b512-4784fda1d4a8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:01.933291 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbfc29-4dcc-4a67-959a-1895269519e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:01.933937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbfc29-4dcc-4a67-959a-1895269519e7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:01.934216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbfc29-4dcc-4a67-959a-1895269519e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:01.934486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbfc29-4dcc-4a67-959a-1895269519e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:01.944054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbfc29-4dcc-4a67-959a-1895269519e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d9dbfc29-4dcc-4a67-959a-1895269519e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:01:01.948982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:01:01.950085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:01:01.950946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 600/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:01:01.956228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edd776-8631-40a2-a619-8de7e13d0425 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:02.010048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:02.052854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edd776-8631-40a2-a619-8de7e13d0425 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:02.085154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a9a27-77f7-44c5-a1b3-6fd3fe9ebee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:02.086351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9a27-77f7-44c5-a1b3-6fd3fe9ebee6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:02.086615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9a27-77f7-44c5-a1b3-6fd3fe9ebee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:02.086882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9a27-77f7-44c5-a1b3-6fd3fe9ebee6 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:02.087528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a9a27-77f7-44c5-a1b3-6fd3fe9ebee6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:01:02.087823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a9a27-77f7-44c5-a1b3-6fd3fe9ebee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:02.089164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a9a27-77f7-44c5-a1b3-6fd3fe9ebee6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:02.096782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 596/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:01:02.102970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbfc29-4dcc-4a67-959a-1895269519e7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:02.199489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbfc29-4dcc-4a67-959a-1895269519e7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:02.232146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b138f17-686c-4988-8b1d-cb87912b5a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:02.232753 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b138f17-686c-4988-8b1d-cb87912b5a26 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:02.233032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b138f17-686c-4988-8b1d-cb87912b5a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:02.233304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b138f17-686c-4988-8b1d-cb87912b5a26 None admin] PATH_INFO: `/v3/users/b3079b76085e4341a607add0aacd43a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:02.234426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b138f17-686c-4988-8b1d-cb87912b5a26 None admin] RBAC: Authorizing `identity:get_user(user_id=b3079b76085e4341a607add0aacd43a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:02.235836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b138f17-686c-4988-8b1d-cb87912b5a26 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:02.237362 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 601/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 19 12:01:02 2022] GET /identity/v3/users/b3079b76085e4341a607add0aacd43a9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:01:02.243014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a9a27-77f7-44c5-a1b3-6fd3fe9ebee6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:02.337466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a9a27-77f7-44c5-a1b3-6fd3fe9ebee6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:02.353759 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:02.370628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebc1b1-2f6e-44d5-aaae-8e00cfae654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:02.371213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebc1b1-2f6e-44d5-aaae-8e00cfae654c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:02.371489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebc1b1-2f6e-44d5-aaae-8e00cfae654c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:02.371760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebc1b1-2f6e-44d5-aaae-8e00cfae654c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:02.435017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebc1b1-2f6e-44d5-aaae-8e00cfae654c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:02.436426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebc1b1-2f6e-44d5-aaae-8e00cfae654c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:02.529970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 597/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:01:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:02.535850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b138f17-686c-4988-8b1d-cb87912b5a26 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:02.559546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:02.631650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b138f17-686c-4988-8b1d-cb87912b5a26 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:02.664107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50d2a8-5f70-4e2a-b163-ba1dfc1646c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:02.664734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d2a8-5f70-4e2a-b163-ba1dfc1646c4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:02.665012 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d2a8-5f70-4e2a-b163-ba1dfc1646c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:02.665286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d2a8-5f70-4e2a-b163-ba1dfc1646c4 None admin] PATH_INFO: `/v3/projects/fe81cdf7934c4e8c9a357d3d6c913022` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:02.666422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50d2a8-5f70-4e2a-b163-ba1dfc1646c4 None admin] RBAC: Authorizing `identity:get_project(project_id=fe81cdf7934c4e8c9a357d3d6c913022)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:02.667845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50d2a8-5f70-4e2a-b163-ba1dfc1646c4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:02.669444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 602/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 19 12:01:02 2022] GET /identity/v3/projects/fe81cdf7934c4e8c9a357d3d6c913022 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:01:02.675488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebc1b1-2f6e-44d5-aaae-8e00cfae654c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:02.694308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:02.773528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebc1b1-2f6e-44d5-aaae-8e00cfae654c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:02.807587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c73053-46af-4df4-ade2-89b35b09a8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:02.808182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73053-46af-4df4-ade2-89b35b09a8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:02.808461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73053-46af-4df4-ade2-89b35b09a8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:02.808732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73053-46af-4df4-ade2-89b35b09a8d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:02.809441 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c73053-46af-4df4-ade2-89b35b09a8d5 None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=fe81cdf7934c4e8c9a357d3d6c913022, user.id=b3079b76085e4341a607add0aacd43a9) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:01:02.809779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c73053-46af-4df4-ade2-89b35b09a8d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:02.811197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c73053-46af-4df4-ade2-89b35b09a8d5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:02.816754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 598/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:01:02 2022] GET /identity/v3/role_assignments?user.id=b3079b76085e4341a607add0aacd43a9&scope.project.id=fe81cdf7934c4e8c9a357d3d6c913022&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:01:12.660406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=55 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:12.814174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=59 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:58.697596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f770b6-7f54-4761-9a7a-7f59d93db799 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:58.698233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f770b6-7f54-4761-9a7a-7f59d93db799 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:58.698233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f770b6-7f54-4761-9a7a-7f59d93db799 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:58.700032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 603/1201] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:01:58.711630 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdb3c6-270b-498c-a62e-3d95f47d3c14 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:58.712225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdb3c6-270b-498c-a62e-3d95f47d3c14 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:58.712225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdb3c6-270b-498c-a62e-3d95f47d3c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:58.737426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c2cdb3c6-270b-498c-a62e-3d95f47d3c14 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:01:58.739234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c2cdb3c6-270b-498c-a62e-3d95f47d3c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:58.852775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 599/1202] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:01:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:01:59.160755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f770b6-7f54-4761-9a7a-7f59d93db799 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:59.295086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f770b6-7f54-4761-9a7a-7f59d93db799 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:59.341378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3d66e-0bd0-4d4b-b874-8fcdc6d67c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:59.342071 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3d66e-0bd0-4d4b-b874-8fcdc6d67c49 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:59.342352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3d66e-0bd0-4d4b-b874-8fcdc6d67c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:59.342623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3d66e-0bd0-4d4b-b874-8fcdc6d67c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:59.359824 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3d66e-0bd0-4d4b-b874-8fcdc6d67c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:59.361779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3d66e-0bd0-4d4b-b874-8fcdc6d67c49 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f8e3d66e-0bd0-4d4b-b874-8fcdc6d67c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:01:59.379225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:01:59.380296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:01:59.381484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:01:59.381484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:01:59.381484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:01:59.383320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 604/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:01:59.390113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdb3c6-270b-498c-a62e-3d95f47d3c14 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:59.521259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdb3c6-270b-498c-a62e-3d95f47d3c14 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:59.564201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:59.573822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c44c44-6ac5-4f54-a1a7-68ae97398848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:59.574621 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c44c44-6ac5-4f54-a1a7-68ae97398848 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:59.574932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c44c44-6ac5-4f54-a1a7-68ae97398848 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:59.575232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c44c44-6ac5-4f54-a1a7-68ae97398848 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:59.575962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c44c44-6ac5-4f54-a1a7-68ae97398848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:01:59.576605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c44c44-6ac5-4f54-a1a7-68ae97398848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:59.578337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c44c44-6ac5-4f54-a1a7-68ae97398848 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:59.599223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 600/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:01:59.600434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3d66e-0bd0-4d4b-b874-8fcdc6d67c49 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:59.683723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:59.752954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3d66e-0bd0-4d4b-b874-8fcdc6d67c49 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:59.792539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba2386-84ab-49e2-bcc0-7c3ab8176765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:59.793076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba2386-84ab-49e2-bcc0-7c3ab8176765 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:59.793354 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba2386-84ab-49e2-bcc0-7c3ab8176765 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:59.793650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba2386-84ab-49e2-bcc0-7c3ab8176765 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:59.794303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba2386-84ab-49e2-bcc0-7c3ab8176765 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:59.795733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba2386-84ab-49e2-bcc0-7c3ab8176765 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:59.824835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 605/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 19 12:01:59 2022] POST /identity/v3/users => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:02:02.310949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857230-3085-4002-80d6-b4cde1311127 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:02.311565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857230-3085-4002-80d6-b4cde1311127 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:02.311565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857230-3085-4002-80d6-b4cde1311127 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:02.313061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 601/1206] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:02:02.319558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0638-83c1-4f2c-b482-2e781d6e1f3c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:02.320091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0638-83c1-4f2c-b482-2e781d6e1f3c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:02.320247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0638-83c1-4f2c-b482-2e781d6e1f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:02.340116 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a76c0638-83c1-4f2c-b482-2e781d6e1f3c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:02.341276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a76c0638-83c1-4f2c-b482-2e781d6e1f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:02.416403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 606/1207] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:02:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:02:02.687043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09857230-3085-4002-80d6-b4cde1311127 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:02.804007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09857230-3085-4002-80d6-b4cde1311127 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:02.841891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404bb9c-67ab-482b-ad95-f1c9326b3d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:02.843457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404bb9c-67ab-482b-ad95-f1c9326b3d61 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:02.843739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404bb9c-67ab-482b-ad95-f1c9326b3d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:02.844023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404bb9c-67ab-482b-ad95-f1c9326b3d61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:02.857650 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404bb9c-67ab-482b-ad95-f1c9326b3d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-2404bb9c-67ab-482b-ad95-f1c9326b3d61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:02:02.862505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:02.869644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:02.870498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 602/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 12:02:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:02.871292 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c0638-83c1-4f2c-b482-2e781d6e1f3c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:02.919677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:02.989898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c0638-83c1-4f2c-b482-2e781d6e1f3c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:03.029063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be6709-97cd-4d47-8588-19c41ab59f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:03.030125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be6709-97cd-4d47-8588-19c41ab59f6c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:03.030597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be6709-97cd-4d47-8588-19c41ab59f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:03.032339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be6709-97cd-4d47-8588-19c41ab59f6c None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:03.032339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be6709-97cd-4d47-8588-19c41ab59f6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:03.032339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be6709-97cd-4d47-8588-19c41ab59f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:03.033428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be6709-97cd-4d47-8588-19c41ab59f6c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:03.043623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 607/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 12:02:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:03.049547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404bb9c-67ab-482b-ad95-f1c9326b3d61 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:03.104904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:03.163849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404bb9c-67ab-482b-ad95-f1c9326b3d61 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:03.199681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3064-d262-46de-98af-b3ee78e7f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:03.200345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3064-d262-46de-98af-b3ee78e7f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:03.200595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3064-d262-46de-98af-b3ee78e7f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:03.200908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3064-d262-46de-98af-b3ee78e7f0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:03.213703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf3064-d262-46de-98af-b3ee78e7f0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:03.215224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf3064-d262-46de-98af-b3ee78e7f0d7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-85cf3064-d262-46de-98af-b3ee78e7f0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:03.232640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:03.234073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:03.234990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:03.234990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:03.234990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:03.234990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 603/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:03.239722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be6709-97cd-4d47-8588-19c41ab59f6c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:03.351850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:03.355728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be6709-97cd-4d47-8588-19c41ab59f6c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:03.400525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6c0b-17b4-4b75-81ff-08592488752e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:03.401144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6c0b-17b4-4b75-81ff-08592488752e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:03.401435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6c0b-17b4-4b75-81ff-08592488752e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:03.401800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6c0b-17b4-4b75-81ff-08592488752e None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:03.402537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6c0b-17b4-4b75-81ff-08592488752e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:03.402839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6c0b-17b4-4b75-81ff-08592488752e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:03.404359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6c0b-17b4-4b75-81ff-08592488752e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:03.418858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 608/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:03.424562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3064-d262-46de-98af-b3ee78e7f0d7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:03.548205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3064-d262-46de-98af-b3ee78e7f0d7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:03.549808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:03.588116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ccd87-b585-45b7-bc8b-d609278a1dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:03.588752 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ccd87-b585-45b7-bc8b-d609278a1dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:03.589035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ccd87-b585-45b7-bc8b-d609278a1dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:03.589393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ccd87-b585-45b7-bc8b-d609278a1dd0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:03.597135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ccd87-b585-45b7-bc8b-d609278a1dd0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:03.598830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ccd87-b585-45b7-bc8b-d609278a1dd0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-853ccd87-b585-45b7-bc8b-d609278a1dd0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 12:02:03.610534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:03.611771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:03.613131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:03.613131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:03.613131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 12:02:03.613131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 12:02:03.613131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 12:02:03.613131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 12:02:03.613131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 12:02:03.613131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 12:02:03.613131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:03.613131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:03.617750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6c0b-17b4-4b75-81ff-08592488752e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:03.619125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 604/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:03.722818 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6c0b-17b4-4b75-81ff-08592488752e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:03.763026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf766114-9582-40c5-82cc-3050847696ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:03.763926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf766114-9582-40c5-82cc-3050847696ff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:03.764395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf766114-9582-40c5-82cc-3050847696ff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:03.764847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf766114-9582-40c5-82cc-3050847696ff None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:03.765804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf766114-9582-40c5-82cc-3050847696ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:03.766321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf766114-9582-40c5-82cc-3050847696ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:03.767970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf766114-9582-40c5-82cc-3050847696ff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:03.787903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 609/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 19 12:02:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:03.793898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ccd87-b585-45b7-bc8b-d609278a1dd0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:03.905905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ccd87-b585-45b7-bc8b-d609278a1dd0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:03.942695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c42c1-1829-4016-9faa-0ee13fc57308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:03.943304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c42c1-1829-4016-9faa-0ee13fc57308 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:03.943776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c42c1-1829-4016-9faa-0ee13fc57308 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:03.944243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c42c1-1829-4016-9faa-0ee13fc57308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:03.979064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:04.030795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c42c1-1829-4016-9faa-0ee13fc57308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:04.032528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c42c1-1829-4016-9faa-0ee13fc57308 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:04.152961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 605/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:02:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 12:02:04.154627 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf766114-9582-40c5-82cc-3050847696ff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:04.176676 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:04.274127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf766114-9582-40c5-82cc-3050847696ff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:04.317662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fa821-f3ac-443d-9127-a47e3242947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:04.319435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fa821-f3ac-443d-9127-a47e3242947c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:04.319435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fa821-f3ac-443d-9127-a47e3242947c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:04.319435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fa821-f3ac-443d-9127-a47e3242947c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:04.330991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fa821-f3ac-443d-9127-a47e3242947c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:04.332720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fa821-f3ac-443d-9127-a47e3242947c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e67fa821-f3ac-443d-9127-a47e3242947c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:04.355188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:04.358602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:04.359725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:04.359725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:04.359725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:04.359725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 610/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 12:02:04.363654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c42c1-1829-4016-9faa-0ee13fc57308 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:04.439351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:04.487921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c42c1-1829-4016-9faa-0ee13fc57308 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:04.529369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be74d3-0105-4a48-a56d-b43e5e4e6829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:04.530037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be74d3-0105-4a48-a56d-b43e5e4e6829 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:04.530330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be74d3-0105-4a48-a56d-b43e5e4e6829 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:04.530585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be74d3-0105-4a48-a56d-b43e5e4e6829 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:04.531299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be74d3-0105-4a48-a56d-b43e5e4e6829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:04.531675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be74d3-0105-4a48-a56d-b43e5e4e6829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:04.533200 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be74d3-0105-4a48-a56d-b43e5e4e6829 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:04.547327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 606/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:04.553160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fa821-f3ac-443d-9127-a47e3242947c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:04.650788 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:04.697036 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fa821-f3ac-443d-9127-a47e3242947c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:04.744353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e823f-7cda-4ff0-8821-3c6d4cc1f2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:04.745136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e823f-7cda-4ff0-8821-3c6d4cc1f2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:04.745407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e823f-7cda-4ff0-8821-3c6d4cc1f2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:04.745815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e823f-7cda-4ff0-8821-3c6d4cc1f2c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:04.753665 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e823f-7cda-4ff0-8821-3c6d4cc1f2c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:04.755096 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e823f-7cda-4ff0-8821-3c6d4cc1f2c0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d45e823f-7cda-4ff0-8821-3c6d4cc1f2c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 12:02:04.768064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:04.769088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:04.770076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 12:02:04.770076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 12:02:04.770076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 12:02:04.770076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 12:02:04.770076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 12:02:04.770076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 12:02:04.770076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:04.770076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:04.770076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 611/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 12:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:04.776497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be74d3-0105-4a48-a56d-b43e5e4e6829 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:04.885358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be74d3-0105-4a48-a56d-b43e5e4e6829 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:04.913315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:04.926177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027e5b6-fb38-481b-b65b-13687c1b197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:04.926791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027e5b6-fb38-481b-b65b-13687c1b197a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:04.927150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027e5b6-fb38-481b-b65b-13687c1b197a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:04.927489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027e5b6-fb38-481b-b65b-13687c1b197a None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:04.928804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027e5b6-fb38-481b-b65b-13687c1b197a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:04.929109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027e5b6-fb38-481b-b65b-13687c1b197a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:04.930655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027e5b6-fb38-481b-b65b-13687c1b197a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:04.942610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 607/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 12:02:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:04.949294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e823f-7cda-4ff0-8821-3c6d4cc1f2c0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:05.064594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e823f-7cda-4ff0-8821-3c6d4cc1f2c0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:05.094038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:05.103207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab22226-7f0a-4141-b9c4-8df4fd27bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:05.103799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab22226-7f0a-4141-b9c4-8df4fd27bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:05.104085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab22226-7f0a-4141-b9c4-8df4fd27bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:05.104347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab22226-7f0a-4141-b9c4-8df4fd27bfe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:05.105064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab22226-7f0a-4141-b9c4-8df4fd27bfe1 None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=1aded088aa2a40e4b7fe024647ebfbed) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:05.105374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab22226-7f0a-4141-b9c4-8df4fd27bfe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:05.106836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab22226-7f0a-4141-b9c4-8df4fd27bfe1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:05.112320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 612/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:02:04 2022] GET /identity/v3/role_assignments?user.id=1aded088aa2a40e4b7fe024647ebfbed&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:07.263981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eb7dd-51e5-4f68-b462-76951102ce2b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:07.264601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eb7dd-51e5-4f68-b462-76951102ce2b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:07.264601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eb7dd-51e5-4f68-b462-76951102ce2b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:07.270324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 608/1220] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:02:07.272168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f037d-1e7d-4143-9a63-eeb5de9fd53c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:07.272732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f037d-1e7d-4143-9a63-eeb5de9fd53c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:07.272732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f037d-1e7d-4143-9a63-eeb5de9fd53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:07.292096 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-032f037d-1e7d-4143-9a63-eeb5de9fd53c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:07.293441 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-032f037d-1e7d-4143-9a63-eeb5de9fd53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:07.373676 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 613/1221] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:02:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:02:07.666847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eb7dd-51e5-4f68-b462-76951102ce2b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:07.784597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eb7dd-51e5-4f68-b462-76951102ce2b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:07.824642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb63cb-cab1-4b3d-9a2b-069812c8a9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:07.825293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb63cb-cab1-4b3d-9a2b-069812c8a9ee None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:07.825696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb63cb-cab1-4b3d-9a2b-069812c8a9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:07.825992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb63cb-cab1-4b3d-9a2b-069812c8a9ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:07.837145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb63cb-cab1-4b3d-9a2b-069812c8a9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f5bb63cb-cab1-4b3d-9a2b-069812c8a9ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:02:07.843105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:07.844078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:07.845045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 609/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 12:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:07.851331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f037d-1e7d-4143-9a63-eeb5de9fd53c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:07.960282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f037d-1e7d-4143-9a63-eeb5de9fd53c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:07.985853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:07.998480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5255cd-5340-49a6-9b66-13cf86e14531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:07.999213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5255cd-5340-49a6-9b66-13cf86e14531 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:07.999497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5255cd-5340-49a6-9b66-13cf86e14531 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:07.999772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5255cd-5340-49a6-9b66-13cf86e14531 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:08.000512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5255cd-5340-49a6-9b66-13cf86e14531 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:08.000817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5255cd-5340-49a6-9b66-13cf86e14531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:08.002411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5255cd-5340-49a6-9b66-13cf86e14531 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:08.012180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 614/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 12:02:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:02:08.018789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb63cb-cab1-4b3d-9a2b-069812c8a9ee None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:08.064745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:08.126160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb63cb-cab1-4b3d-9a2b-069812c8a9ee None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:08.162645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543793e-957c-438e-80be-f722a0f363b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:08.163272 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543793e-957c-438e-80be-f722a0f363b2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:08.163540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543793e-957c-438e-80be-f722a0f363b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:08.163808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543793e-957c-438e-80be-f722a0f363b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:08.174849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543793e-957c-438e-80be-f722a0f363b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:08.176293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543793e-957c-438e-80be-f722a0f363b2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e543793e-957c-438e-80be-f722a0f363b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:08.193935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:08.195187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:08.196300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:08.196300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:08.196300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:08.196300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 610/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:08.201922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5255cd-5340-49a6-9b66-13cf86e14531 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:08.312723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5255cd-5340-49a6-9b66-13cf86e14531 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:08.351926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76efc1-a7ef-4214-a500-61c10bf6f982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:08.352599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76efc1-a7ef-4214-a500-61c10bf6f982 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:08.352900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76efc1-a7ef-4214-a500-61c10bf6f982 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:08.353270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76efc1-a7ef-4214-a500-61c10bf6f982 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:08.354092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76efc1-a7ef-4214-a500-61c10bf6f982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:08.354469 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76efc1-a7ef-4214-a500-61c10bf6f982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:08.356064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76efc1-a7ef-4214-a500-61c10bf6f982 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:08.371556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 615/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:08.378795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543793e-957c-438e-80be-f722a0f363b2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:08.494523 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:08.505190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543793e-957c-438e-80be-f722a0f363b2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:08.544486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dbea2-c624-4eb1-9701-6c817ea0e881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:08.545196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dbea2-c624-4eb1-9701-6c817ea0e881 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:08.545482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dbea2-c624-4eb1-9701-6c817ea0e881 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:08.545791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dbea2-c624-4eb1-9701-6c817ea0e881 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:08.554008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dbea2-c624-4eb1-9701-6c817ea0e881 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:08.555459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dbea2-c624-4eb1-9701-6c817ea0e881 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-9d0dbea2-c624-4eb1-9701-6c817ea0e881 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 12:02:08.567993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:08.569124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:08.570257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 611/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 12:02:08.575539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76efc1-a7ef-4214-a500-61c10bf6f982 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:08.624658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:08.681758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76efc1-a7ef-4214-a500-61c10bf6f982 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:08.719547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a743b9-e762-485e-890b-ddaa07c6ea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:08.720166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a743b9-e762-485e-890b-ddaa07c6ea45 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:08.720439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a743b9-e762-485e-890b-ddaa07c6ea45 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:08.720703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a743b9-e762-485e-890b-ddaa07c6ea45 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:08.721422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a743b9-e762-485e-890b-ddaa07c6ea45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:08.721846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a743b9-e762-485e-890b-ddaa07c6ea45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:08.723199 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a743b9-e762-485e-890b-ddaa07c6ea45 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:08.743923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 616/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 19 12:02:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:08.750207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dbea2-c624-4eb1-9701-6c817ea0e881 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:08.857792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dbea2-c624-4eb1-9701-6c817ea0e881 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:08.895553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d20b69-2e3d-4f7a-a2dd-1eb40330e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:08.896190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d20b69-2e3d-4f7a-a2dd-1eb40330e635 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:08.896513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d20b69-2e3d-4f7a-a2dd-1eb40330e635 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:08.896762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d20b69-2e3d-4f7a-a2dd-1eb40330e635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:08.908232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d20b69-2e3d-4f7a-a2dd-1eb40330e635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:08.909776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d20b69-2e3d-4f7a-a2dd-1eb40330e635 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-37d20b69-2e3d-4f7a-a2dd-1eb40330e635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:08.925500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:08.926691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:08.928467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:08.928467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:08.928467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:08.928467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 612/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:08.933401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a743b9-e762-485e-890b-ddaa07c6ea45 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.043793 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a743b9-e762-485e-890b-ddaa07c6ea45 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.046274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:09.079957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8edc75-c1b7-4ab3-840c-405baf02919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.080562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8edc75-c1b7-4ab3-840c-405baf02919c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.080844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8edc75-c1b7-4ab3-840c-405baf02919c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.081115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8edc75-c1b7-4ab3-840c-405baf02919c None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.081786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8edc75-c1b7-4ab3-840c-405baf02919c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:09.082091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8edc75-c1b7-4ab3-840c-405baf02919c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.083450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8edc75-c1b7-4ab3-840c-405baf02919c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.096667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 617/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:09.103830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d20b69-2e3d-4f7a-a2dd-1eb40330e635 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.115158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:09.215480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d20b69-2e3d-4f7a-a2dd-1eb40330e635 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.250109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa4165-01ae-41d3-9a55-608d53b08a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.250733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa4165-01ae-41d3-9a55-608d53b08a3a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.251012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa4165-01ae-41d3-9a55-608d53b08a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.251367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa4165-01ae-41d3-9a55-608d53b08a3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.258033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa4165-01ae-41d3-9a55-608d53b08a3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.259466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa4165-01ae-41d3-9a55-608d53b08a3a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-bbaa4165-01ae-41d3-9a55-608d53b08a3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 12:02:09.271394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:09.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:09.274090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 12:02:09.274090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 12:02:09.274090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 12:02:09.274090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 12:02:09.274090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 12:02:09.274090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 12:02:09.274090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:09.274090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:09.274090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 613/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 12:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:09.279361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8edc75-c1b7-4ab3-840c-405baf02919c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.390886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8edc75-c1b7-4ab3-840c-405baf02919c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.430050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1293b4e-635d-49ea-85c6-155734f56167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.430679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1293b4e-635d-49ea-85c6-155734f56167 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.430945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1293b4e-635d-49ea-85c6-155734f56167 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.431218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1293b4e-635d-49ea-85c6-155734f56167 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.431898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1293b4e-635d-49ea-85c6-155734f56167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:09.432201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1293b4e-635d-49ea-85c6-155734f56167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.433642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1293b4e-635d-49ea-85c6-155734f56167 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.446675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 618/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 12:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:09.454354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa4165-01ae-41d3-9a55-608d53b08a3a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.534080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:09.575933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa4165-01ae-41d3-9a55-608d53b08a3a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.609216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a3cad-41c1-44e8-8e37-1075b60ec4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.609897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a3cad-41c1-44e8-8e37-1075b60ec4b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.610178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a3cad-41c1-44e8-8e37-1075b60ec4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.610449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a3cad-41c1-44e8-8e37-1075b60ec4b8 None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/1aded088aa2a40e4b7fe024647ebfbed/roles/c926095789574c45a0a5fd3f2a25262f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.626090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a3cad-41c1-44e8-8e37-1075b60ec4b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=1aded088aa2a40e4b7fe024647ebfbed, role_id=c926095789574c45a0a5fd3f2a25262f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.627523 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a3cad-41c1-44e8-8e37-1075b60ec4b8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.640104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 614/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 12:02:09 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/1aded088aa2a40e4b7fe024647ebfbed/roles/c926095789574c45a0a5fd3f2a25262f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:02:11.794437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6354f-371e-43ab-a001-2982c1c84f5e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:11.794997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6354f-371e-43ab-a001-2982c1c84f5e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:11.794997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6354f-371e-43ab-a001-2982c1c84f5e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:11.796389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 619/1233] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:02:11.802438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9d07-b1e9-4ca7-ba43-f45e2203b279 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:11.803646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9d07-b1e9-4ca7-ba43-f45e2203b279 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:11.803739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9d07-b1e9-4ca7-ba43-f45e2203b279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:11.822797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f0bb9d07-b1e9-4ca7-ba43-f45e2203b279 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:11.823980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f0bb9d07-b1e9-4ca7-ba43-f45e2203b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:11.894399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 615/1234] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:02:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:02:12.182673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6354f-371e-43ab-a001-2982c1c84f5e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:12.210061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:12.296183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6354f-371e-43ab-a001-2982c1c84f5e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:12.336314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16a030-41ec-4f81-b227-2cbee7e25ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:12.337085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16a030-41ec-4f81-b227-2cbee7e25ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:12.337358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16a030-41ec-4f81-b227-2cbee7e25ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:12.337647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16a030-41ec-4f81-b227-2cbee7e25ad7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:12.348363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16a030-41ec-4f81-b227-2cbee7e25ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5e16a030-41ec-4f81-b227-2cbee7e25ad7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:02:12.353825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:12.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:12.356933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 620/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 19 12:02:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:12.362034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9d07-b1e9-4ca7-ba43-f45e2203b279 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:12.418638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:12.476052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9d07-b1e9-4ca7-ba43-f45e2203b279 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:12.512097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3547b1d-4ed6-4de3-825a-69e154af94b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:12.512700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3547b1d-4ed6-4de3-825a-69e154af94b1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:12.512964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3547b1d-4ed6-4de3-825a-69e154af94b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:12.513281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3547b1d-4ed6-4de3-825a-69e154af94b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:12.513910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3547b1d-4ed6-4de3-825a-69e154af94b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:12.514212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3547b1d-4ed6-4de3-825a-69e154af94b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:12.515571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3547b1d-4ed6-4de3-825a-69e154af94b1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:12.525120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 616/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 19 12:02:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:12.530928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16a030-41ec-4f81-b227-2cbee7e25ad7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:12.619094 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:12.635396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16a030-41ec-4f81-b227-2cbee7e25ad7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:12.670201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a628c-237a-42eb-9a21-411bbf8f28cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:12.670835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a628c-237a-42eb-9a21-411bbf8f28cf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:12.671191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a628c-237a-42eb-9a21-411bbf8f28cf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:12.671377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a628c-237a-42eb-9a21-411bbf8f28cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:12.682741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a628c-237a-42eb-9a21-411bbf8f28cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:12.684215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a628c-237a-42eb-9a21-411bbf8f28cf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-966a628c-237a-42eb-9a21-411bbf8f28cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:12.700319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:12.701590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:12.702723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:12.702723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:12.702723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:12.707868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 621/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:12.708795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3547b1d-4ed6-4de3-825a-69e154af94b1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:12.826356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3547b1d-4ed6-4de3-825a-69e154af94b1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:12.840299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:12.879674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf2d08-1ff6-4aa8-8a1a-9621e8335c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:12.880590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf2d08-1ff6-4aa8-8a1a-9621e8335c11 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:12.880989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf2d08-1ff6-4aa8-8a1a-9621e8335c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:12.881275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf2d08-1ff6-4aa8-8a1a-9621e8335c11 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:12.882044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf2d08-1ff6-4aa8-8a1a-9621e8335c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:12.882375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf2d08-1ff6-4aa8-8a1a-9621e8335c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:12.883726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf2d08-1ff6-4aa8-8a1a-9621e8335c11 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:12.897728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 617/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:12.904282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a628c-237a-42eb-9a21-411bbf8f28cf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:13.028575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a628c-237a-42eb-9a21-411bbf8f28cf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:13.070757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4f0d2-0a9b-4d39-b75c-740064773ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:13.071676 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f0d2-0a9b-4d39-b75c-740064773ecf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:13.071959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f0d2-0a9b-4d39-b75c-740064773ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:13.072229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f0d2-0a9b-4d39-b75c-740064773ecf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:13.075782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:13.081573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4f0d2-0a9b-4d39-b75c-740064773ecf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:13.083612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4f0d2-0a9b-4d39-b75c-740064773ecf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e6c4f0d2-0a9b-4d39-b75c-740064773ecf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 12:02:13.096572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:13.097723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:13.099128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 622/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:13.104325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf2d08-1ff6-4aa8-8a1a-9621e8335c11 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:13.221647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf2d08-1ff6-4aa8-8a1a-9621e8335c11 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:13.261338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7e44a-db49-46a9-a4b8-2c171339f9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:13.262010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7e44a-db49-46a9-a4b8-2c171339f9ca None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:13.262335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7e44a-db49-46a9-a4b8-2c171339f9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:13.262540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7e44a-db49-46a9-a4b8-2c171339f9ca None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:13.263380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7e44a-db49-46a9-a4b8-2c171339f9ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:13.263745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7e44a-db49-46a9-a4b8-2c171339f9ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:13.265161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7e44a-db49-46a9-a4b8-2c171339f9ca None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:13.283573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 618/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 19 12:02:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:02:13.290149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4f0d2-0a9b-4d39-b75c-740064773ecf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:13.403601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4f0d2-0a9b-4d39-b75c-740064773ecf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:13.441675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121d77e-d0ae-49fd-99e7-8b4c03bb2cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:13.442433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d77e-d0ae-49fd-99e7-8b4c03bb2cff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:13.442820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d77e-d0ae-49fd-99e7-8b4c03bb2cff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:13.443876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d77e-d0ae-49fd-99e7-8b4c03bb2cff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:13.509991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:13.517779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121d77e-d0ae-49fd-99e7-8b4c03bb2cff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:13.519246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121d77e-d0ae-49fd-99e7-8b4c03bb2cff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:13.638500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 623/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:02:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:13.644411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7e44a-db49-46a9-a4b8-2c171339f9ca None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:13.674371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:13.754396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7e44a-db49-46a9-a4b8-2c171339f9ca None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:13.793101 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9768ce-1a0b-49b7-8a4e-471d43987345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:13.793827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9768ce-1a0b-49b7-8a4e-471d43987345 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:13.794228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9768ce-1a0b-49b7-8a4e-471d43987345 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:13.794558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9768ce-1a0b-49b7-8a4e-471d43987345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:13.806593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9768ce-1a0b-49b7-8a4e-471d43987345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:13.808194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9768ce-1a0b-49b7-8a4e-471d43987345 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0f9768ce-1a0b-49b7-8a4e-471d43987345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:13.824140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:13.825310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:13.826905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:13.826905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:13.826905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:13.830061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 619/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:13.831105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121d77e-d0ae-49fd-99e7-8b4c03bb2cff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:13.934224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:13.940638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121d77e-d0ae-49fd-99e7-8b4c03bb2cff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:13.978577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d054e5-3bab-47e1-85bb-d69da412f039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:13.979215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d054e5-3bab-47e1-85bb-d69da412f039 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:13.979502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d054e5-3bab-47e1-85bb-d69da412f039 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:13.979790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d054e5-3bab-47e1-85bb-d69da412f039 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:13.980412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d054e5-3bab-47e1-85bb-d69da412f039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:13.980714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d054e5-3bab-47e1-85bb-d69da412f039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:13.982140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d054e5-3bab-47e1-85bb-d69da412f039 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:13.993938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 624/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:13.999758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9768ce-1a0b-49b7-8a4e-471d43987345 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:14.095898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:14.119859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9768ce-1a0b-49b7-8a4e-471d43987345 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:14.154655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f46557-784b-4842-9ad9-6b0fb9e665d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:14.155286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f46557-784b-4842-9ad9-6b0fb9e665d5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:14.155557 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f46557-784b-4842-9ad9-6b0fb9e665d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:14.155833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f46557-784b-4842-9ad9-6b0fb9e665d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:14.163182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f46557-784b-4842-9ad9-6b0fb9e665d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:14.164607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f46557-784b-4842-9ad9-6b0fb9e665d5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e0f46557-784b-4842-9ad9-6b0fb9e665d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 12:02:14.175814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:14.176923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:14.178452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 12:02:14.178452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 12:02:14.178452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 12:02:14.178452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 12:02:14.178452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 12:02:14.178452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 12:02:14.178452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:14.178452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:14.181907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 620/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 12:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:14.182950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d054e5-3bab-47e1-85bb-d69da412f039 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:14.289533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d054e5-3bab-47e1-85bb-d69da412f039 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:14.325361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eda1e6-a5dd-495c-ad41-4406db20aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:14.326018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eda1e6-a5dd-495c-ad41-4406db20aa79 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:14.326296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eda1e6-a5dd-495c-ad41-4406db20aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:14.326568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eda1e6-a5dd-495c-ad41-4406db20aa79 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:14.327356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eda1e6-a5dd-495c-ad41-4406db20aa79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:14.327779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eda1e6-a5dd-495c-ad41-4406db20aa79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:14.329364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eda1e6-a5dd-495c-ad41-4406db20aa79 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:14.343111 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 625/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 12:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:02:14.350152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f46557-784b-4842-9ad9-6b0fb9e665d5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:14.471285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f46557-784b-4842-9ad9-6b0fb9e665d5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:14.509309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee833f-afd8-4abf-8006-3cb1ad365b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:14.509941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee833f-afd8-4abf-8006-3cb1ad365b3e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:14.510238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee833f-afd8-4abf-8006-3cb1ad365b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:14.510489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee833f-afd8-4abf-8006-3cb1ad365b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:14.511216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee833f-afd8-4abf-8006-3cb1ad365b3e None admin] RBAC: Adding query filter params (role.id=c926095789574c45a0a5fd3f2a25262f, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=1aded088aa2a40e4b7fe024647ebfbed) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:14.511507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee833f-afd8-4abf-8006-3cb1ad365b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:14.512918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee833f-afd8-4abf-8006-3cb1ad365b3e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:14.518868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 621/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:02:14 2022] GET /identity/v3/role_assignments?user.id=1aded088aa2a40e4b7fe024647ebfbed&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=c926095789574c45a0a5fd3f2a25262f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:16.874366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2919099-e72b-461a-95e1-516bdcc8f5e2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:16.874921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2919099-e72b-461a-95e1-516bdcc8f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:16.874921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2919099-e72b-461a-95e1-516bdcc8f5e2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:16.876619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 626/1247] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 12:02:16.882376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f005-b5a5-4d31-8fd3-b9bd907b3962 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:16.882864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f005-b5a5-4d31-8fd3-b9bd907b3962 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:16.883005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f005-b5a5-4d31-8fd3-b9bd907b3962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:16.889909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:16.903710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7a94f005-b5a5-4d31-8fd3-b9bd907b3962 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:16.904912 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7a94f005-b5a5-4d31-8fd3-b9bd907b3962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:16.976207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 622/1248] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:02:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:02:17.249701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2919099-e72b-461a-95e1-516bdcc8f5e2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:17.267789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:17.358946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2919099-e72b-461a-95e1-516bdcc8f5e2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:17.397962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdc4af-91b5-4ae7-91ac-de9de5f788fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:17.398594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdc4af-91b5-4ae7-91ac-de9de5f788fa None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:17.398872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdc4af-91b5-4ae7-91ac-de9de5f788fa None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:17.399146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdc4af-91b5-4ae7-91ac-de9de5f788fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:17.410391 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdc4af-91b5-4ae7-91ac-de9de5f788fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2bbdc4af-91b5-4ae7-91ac-de9de5f788fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:02:17.416196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:17.417355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:02:17.418401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:17.425376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 627/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:02:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:17.425510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94f005-b5a5-4d31-8fd3-b9bd907b3962 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:17.532788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94f005-b5a5-4d31-8fd3-b9bd907b3962 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:17.563802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:17.569338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517860f-6760-481c-8c0f-6376fb56a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:17.569972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517860f-6760-481c-8c0f-6376fb56a46f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:17.570280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517860f-6760-481c-8c0f-6376fb56a46f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:17.570524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517860f-6760-481c-8c0f-6376fb56a46f None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:17.571308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517860f-6760-481c-8c0f-6376fb56a46f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:17.571610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517860f-6760-481c-8c0f-6376fb56a46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:17.572974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517860f-6760-481c-8c0f-6376fb56a46f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:17.581982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 623/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:02:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:17.588929 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdc4af-91b5-4ae7-91ac-de9de5f788fa None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:17.675307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:17.702371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdc4af-91b5-4ae7-91ac-de9de5f788fa None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:17.740632 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e851f2-894c-4e17-a1ff-73eb3d6b6817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:17.741411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e851f2-894c-4e17-a1ff-73eb3d6b6817 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:17.741716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e851f2-894c-4e17-a1ff-73eb3d6b6817 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:17.741990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e851f2-894c-4e17-a1ff-73eb3d6b6817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:17.752914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e851f2-894c-4e17-a1ff-73eb3d6b6817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:17.754470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e851f2-894c-4e17-a1ff-73eb3d6b6817 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-92e851f2-894c-4e17-a1ff-73eb3d6b6817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:17.771026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:17.772886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:17.774140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:17.774140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:17.774140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:17.774140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 628/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:17.778139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517860f-6760-481c-8c0f-6376fb56a46f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:17.901725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517860f-6760-481c-8c0f-6376fb56a46f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:17.938766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970f76b-ca58-494b-96d0-057d09f67b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:17.939380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f76b-ca58-494b-96d0-057d09f67b88 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:17.939660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f76b-ca58-494b-96d0-057d09f67b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:17.939933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f76b-ca58-494b-96d0-057d09f67b88 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:17.940581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970f76b-ca58-494b-96d0-057d09f67b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:17.940887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970f76b-ca58-494b-96d0-057d09f67b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:17.942308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970f76b-ca58-494b-96d0-057d09f67b88 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:17.955095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 624/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:17.961029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e851f2-894c-4e17-a1ff-73eb3d6b6817 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:18.064136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e851f2-894c-4e17-a1ff-73eb3d6b6817 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:18.092490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:18.101056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bd8af-c9e1-4d57-8745-9b3c7c0fe2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:18.101758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bd8af-c9e1-4d57-8745-9b3c7c0fe2fb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:18.102039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bd8af-c9e1-4d57-8745-9b3c7c0fe2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:18.102312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bd8af-c9e1-4d57-8745-9b3c7c0fe2fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:18.110739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bd8af-c9e1-4d57-8745-9b3c7c0fe2fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:18.112215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bd8af-c9e1-4d57-8745-9b3c7c0fe2fb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-561bd8af-c9e1-4d57-8745-9b3c7c0fe2fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 12:02:18.125335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:18.126553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:18.127501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 629/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:18.133047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970f76b-ca58-494b-96d0-057d09f67b88 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:18.190754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:18.238252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970f76b-ca58-494b-96d0-057d09f67b88 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:18.272703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd403ddd-29ce-4450-a5e2-6f67a635a1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:18.273303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd403ddd-29ce-4450-a5e2-6f67a635a1ec None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:18.273577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd403ddd-29ce-4450-a5e2-6f67a635a1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:18.273915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd403ddd-29ce-4450-a5e2-6f67a635a1ec None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:18.274630 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd403ddd-29ce-4450-a5e2-6f67a635a1ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:18.275691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd403ddd-29ce-4450-a5e2-6f67a635a1ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:18.276338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd403ddd-29ce-4450-a5e2-6f67a635a1ec None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:18.294322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 625/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 19 12:02:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:18.300335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bd8af-c9e1-4d57-8745-9b3c7c0fe2fb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:18.417984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bd8af-c9e1-4d57-8745-9b3c7c0fe2fb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:18.455214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1becc2-e326-4521-bc3e-a5fa3f14e768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:18.455742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1becc2-e326-4521-bc3e-a5fa3f14e768 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:18.456021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1becc2-e326-4521-bc3e-a5fa3f14e768 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:18.456301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1becc2-e326-4521-bc3e-a5fa3f14e768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:18.510181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:18.522623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1becc2-e326-4521-bc3e-a5fa3f14e768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:18.524059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1becc2-e326-4521-bc3e-a5fa3f14e768 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:18.616698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 630/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:02:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:18.622640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd403ddd-29ce-4450-a5e2-6f67a635a1ec None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:18.727049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd403ddd-29ce-4450-a5e2-6f67a635a1ec None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:18.739458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:18.760383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b07e3a-8095-4b12-832a-5dab7c08844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:18.761002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b07e3a-8095-4b12-832a-5dab7c08844a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:18.761279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b07e3a-8095-4b12-832a-5dab7c08844a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:18.761548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b07e3a-8095-4b12-832a-5dab7c08844a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:18.771091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b07e3a-8095-4b12-832a-5dab7c08844a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:18.773120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b07e3a-8095-4b12-832a-5dab7c08844a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d0b07e3a-8095-4b12-832a-5dab7c08844a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:18.787879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:18.789028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:18.790135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:18.790135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:18.790135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:18.790135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 626/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:18.794651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1becc2-e326-4521-bc3e-a5fa3f14e768 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:18.876806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:18.888853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1becc2-e326-4521-bc3e-a5fa3f14e768 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:18.920419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1502017-2990-4d11-a49b-7b079145ffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:18.921007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502017-2990-4d11-a49b-7b079145ffda None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:18.921284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502017-2990-4d11-a49b-7b079145ffda None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:18.921552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502017-2990-4d11-a49b-7b079145ffda None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:18.922201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1502017-2990-4d11-a49b-7b079145ffda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:18.922499 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1502017-2990-4d11-a49b-7b079145ffda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:18.923849 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1502017-2990-4d11-a49b-7b079145ffda None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:18.935003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 631/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:02:18.940596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b07e3a-8095-4b12-832a-5dab7c08844a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:19.041059 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b07e3a-8095-4b12-832a-5dab7c08844a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:19.074505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5b55-fb13-4242-a977-c30f4db68944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:19.075124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5b55-fb13-4242-a977-c30f4db68944 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:19.075404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5b55-fb13-4242-a977-c30f4db68944 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:19.075674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5b55-fb13-4242-a977-c30f4db68944 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:19.082067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b5b55-fb13-4242-a977-c30f4db68944 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:19.083498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b5b55-fb13-4242-a977-c30f4db68944 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-946b5b55-fb13-4242-a977-c30f4db68944 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 12:02:19.094645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:19.095653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:19.096746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 12:02:19.096746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 12:02:19.096746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 12:02:19.096746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 12:02:19.096746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 12:02:19.096746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 12:02:19.096746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:19.096746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:19.096746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 627/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 12:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:19.102145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1502017-2990-4d11-a49b-7b079145ffda None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:19.198532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1502017-2990-4d11-a49b-7b079145ffda None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:19.231117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812a03f-0e9e-408b-b2f3-1d531f0900d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:19.231716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812a03f-0e9e-408b-b2f3-1d531f0900d4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:19.231998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812a03f-0e9e-408b-b2f3-1d531f0900d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:19.232273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812a03f-0e9e-408b-b2f3-1d531f0900d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:19.232951 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812a03f-0e9e-408b-b2f3-1d531f0900d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:19.233257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812a03f-0e9e-408b-b2f3-1d531f0900d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:19.234705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812a03f-0e9e-408b-b2f3-1d531f0900d4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:19.247210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 632/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 12:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:19.253250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5b55-fb13-4242-a977-c30f4db68944 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:19.278294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:19.350453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5b55-fb13-4242-a977-c30f4db68944 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:19.387643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd96d2-74c6-4d0c-aac3-5ca57aae2b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:19.388346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd96d2-74c6-4d0c-aac3-5ca57aae2b19 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:19.388675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd96d2-74c6-4d0c-aac3-5ca57aae2b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:19.388989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd96d2-74c6-4d0c-aac3-5ca57aae2b19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:19.389849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd96d2-74c6-4d0c-aac3-5ca57aae2b19 None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=1aded088aa2a40e4b7fe024647ebfbed) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:19.390166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd96d2-74c6-4d0c-aac3-5ca57aae2b19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:19.391709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd96d2-74c6-4d0c-aac3-5ca57aae2b19 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:19.397752 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 628/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:02:19 2022] GET /identity/v3/role_assignments?user.id=1aded088aa2a40e4b7fe024647ebfbed&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:21.490786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c41900-2090-4c5c-a5e2-8e77c062a384 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:21.491343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c41900-2090-4c5c-a5e2-8e77c062a384 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:21.491343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c41900-2090-4c5c-a5e2-8e77c062a384 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:21.492639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 633/1261] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:02:21.497850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a9fbd-12b3-4799-a018-07661cb1ffca None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:21.498267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a9fbd-12b3-4799-a018-07661cb1ffca None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:21.498404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a9fbd-12b3-4799-a018-07661cb1ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:21.517042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4f2a9fbd-12b3-4799-a018-07661cb1ffca None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:21.518259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4f2a9fbd-12b3-4799-a018-07661cb1ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:21.582855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 629/1262] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:02:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:02:21.853650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c41900-2090-4c5c-a5e2-8e77c062a384 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:21.864308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:21.950362 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c41900-2090-4c5c-a5e2-8e77c062a384 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:21.982947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51495ea-4d91-4887-83f7-c645af2174ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:21.983559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51495ea-4d91-4887-83f7-c645af2174ee None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:21.983839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51495ea-4d91-4887-83f7-c645af2174ee None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:21.984111 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51495ea-4d91-4887-83f7-c645af2174ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:21.994519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51495ea-4d91-4887-83f7-c645af2174ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e51495ea-4d91-4887-83f7-c645af2174ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:02:21.999331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:22.000374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:22.001648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 634/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:02:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:22.006965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a9fbd-12b3-4799-a018-07661cb1ffca None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:22.024730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:22.102131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a9fbd-12b3-4799-a018-07661cb1ffca None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:22.134361 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd7a4-d0fe-4df7-8d14-d080b422e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:22.134898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd7a4-d0fe-4df7-8d14-d080b422e9aa None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:22.135174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd7a4-d0fe-4df7-8d14-d080b422e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:22.135439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd7a4-d0fe-4df7-8d14-d080b422e9aa None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:22.136085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fd7a4-d0fe-4df7-8d14-d080b422e9aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:22.136384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fd7a4-d0fe-4df7-8d14-d080b422e9aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:22.137752 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fd7a4-d0fe-4df7-8d14-d080b422e9aa None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:22.145348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 630/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:02:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:22.151547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51495ea-4d91-4887-83f7-c645af2174ee None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:22.216302 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:22.248680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51495ea-4d91-4887-83f7-c645af2174ee None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:22.281745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b55b-134e-4e9c-a452-e4f85a1995cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:22.282352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b55b-134e-4e9c-a452-e4f85a1995cb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:22.282630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b55b-134e-4e9c-a452-e4f85a1995cb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:22.282902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b55b-134e-4e9c-a452-e4f85a1995cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:22.292523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12b55b-134e-4e9c-a452-e4f85a1995cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:22.293968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12b55b-134e-4e9c-a452-e4f85a1995cb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-4a12b55b-134e-4e9c-a452-e4f85a1995cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:22.307905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:22.309000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:22.309918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:22.309918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:22.309918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:22.309918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 635/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:22.314610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd7a4-d0fe-4df7-8d14-d080b422e9aa None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:22.398652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:22.418753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd7a4-d0fe-4df7-8d14-d080b422e9aa None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:22.451611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90c8fa-00a4-433d-a6cb-c8959adf8479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:22.452213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90c8fa-00a4-433d-a6cb-c8959adf8479 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:22.452492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90c8fa-00a4-433d-a6cb-c8959adf8479 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:22.452770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90c8fa-00a4-433d-a6cb-c8959adf8479 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:22.453401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90c8fa-00a4-433d-a6cb-c8959adf8479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:22.453733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90c8fa-00a4-433d-a6cb-c8959adf8479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:22.455120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90c8fa-00a4-433d-a6cb-c8959adf8479 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:22.467753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 631/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:22.473432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b55b-134e-4e9c-a452-e4f85a1995cb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:22.569415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b55b-134e-4e9c-a452-e4f85a1995cb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:22.588685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:22.602623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3710256-ea27-4157-8712-ee45c875a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:22.603238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3710256-ea27-4157-8712-ee45c875a9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:22.603517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3710256-ea27-4157-8712-ee45c875a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:22.603786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3710256-ea27-4157-8712-ee45c875a9c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:22.610937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3710256-ea27-4157-8712-ee45c875a9c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:22.612361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3710256-ea27-4157-8712-ee45c875a9c9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b3710256-ea27-4157-8712-ee45c875a9c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 12:02:22.623642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:22.624731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:22.626066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 636/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:22.630430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90c8fa-00a4-433d-a6cb-c8959adf8479 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:22.726297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90c8fa-00a4-433d-a6cb-c8959adf8479 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:22.759422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9952345-92e7-442a-89d2-4de6ca1cef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:22.760006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952345-92e7-442a-89d2-4de6ca1cef81 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:22.760280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952345-92e7-442a-89d2-4de6ca1cef81 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:22.760547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952345-92e7-442a-89d2-4de6ca1cef81 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:22.761253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9952345-92e7-442a-89d2-4de6ca1cef81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:22.761551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9952345-92e7-442a-89d2-4de6ca1cef81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:22.762976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9952345-92e7-442a-89d2-4de6ca1cef81 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:22.771170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:22.779452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 632/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 19 12:02:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:02:22.785186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3710256-ea27-4157-8712-ee45c875a9c9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:22.883027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3710256-ea27-4157-8712-ee45c875a9c9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:22.915584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1abc1f-86a5-4da6-a68f-2591b34e6e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:22.916191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1abc1f-86a5-4da6-a68f-2591b34e6e5d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:22.916472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1abc1f-86a5-4da6-a68f-2591b34e6e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:22.916746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1abc1f-86a5-4da6-a68f-2591b34e6e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:22.926865 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1abc1f-86a5-4da6-a68f-2591b34e6e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:22.929107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1abc1f-86a5-4da6-a68f-2591b34e6e5d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5b1abc1f-86a5-4da6-a68f-2591b34e6e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:22.942768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:22.944341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:22.945507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:22.945507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:22.945507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:22.945507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 637/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:22.950366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9952345-92e7-442a-89d2-4de6ca1cef81 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:23.045762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9952345-92e7-442a-89d2-4de6ca1cef81 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:23.078674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef4cec-53a1-404a-a656-ae50e5ae0017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:23.079270 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef4cec-53a1-404a-a656-ae50e5ae0017 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:23.079548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef4cec-53a1-404a-a656-ae50e5ae0017 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:23.079815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef4cec-53a1-404a-a656-ae50e5ae0017 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:23.080440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef4cec-53a1-404a-a656-ae50e5ae0017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:23.080738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef4cec-53a1-404a-a656-ae50e5ae0017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:23.082113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef4cec-53a1-404a-a656-ae50e5ae0017 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:23.092789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 633/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:23.100270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1abc1f-86a5-4da6-a68f-2591b34e6e5d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:23.131367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:23.197442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1abc1f-86a5-4da6-a68f-2591b34e6e5d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:23.233667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6187-d696-4039-9ea9-5e516778d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:23.234294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6187-d696-4039-9ea9-5e516778d357 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:23.234575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6187-d696-4039-9ea9-5e516778d357 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:23.234846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6187-d696-4039-9ea9-5e516778d357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:23.242015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6187-d696-4039-9ea9-5e516778d357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:23.243440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6187-d696-4039-9ea9-5e516778d357 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7bcb6187-d696-4039-9ea9-5e516778d357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 12:02:23.254308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:23.255294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:23.256299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 12:02:23.256299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 12:02:23.256299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 12:02:23.256299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 12:02:23.256299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 12:02:23.256299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 12:02:23.256299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:23.256299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:23.256299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 638/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 12:02:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:23.261458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef4cec-53a1-404a-a656-ae50e5ae0017 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:23.317222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:23.359078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef4cec-53a1-404a-a656-ae50e5ae0017 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:23.393354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408715f-569f-45ac-9118-71304435d940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:23.393979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408715f-569f-45ac-9118-71304435d940 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:23.394258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408715f-569f-45ac-9118-71304435d940 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:23.394528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408715f-569f-45ac-9118-71304435d940 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:23.395215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408715f-569f-45ac-9118-71304435d940 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:23.395518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408715f-569f-45ac-9118-71304435d940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:23.397450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408715f-569f-45ac-9118-71304435d940 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:23.408938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 634/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 12:02:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:23.415606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6187-d696-4039-9ea9-5e516778d357 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:23.516340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:23.525343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6187-d696-4039-9ea9-5e516778d357 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:23.557705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca261f8d-c23c-47df-9f2f-83a138408185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:23.558350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261f8d-c23c-47df-9f2f-83a138408185 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:23.558624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261f8d-c23c-47df-9f2f-83a138408185 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:23.558900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261f8d-c23c-47df-9f2f-83a138408185 None admin] PATH_INFO: `/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/1aded088aa2a40e4b7fe024647ebfbed/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:23.560729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca261f8d-c23c-47df-9f2f-83a138408185 None admin] RBAC: Authorizing `identity:create_grant(project_id=799dfd7d80ef4359964b56a02315bf35, user_id=1aded088aa2a40e4b7fe024647ebfbed, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:23.562175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca261f8d-c23c-47df-9f2f-83a138408185 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:23.574713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 639/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 19 12:02:23 2022] PUT /identity/v3/projects/799dfd7d80ef4359964b56a02315bf35/users/1aded088aa2a40e4b7fe024647ebfbed/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:02:25.710562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08578989-96a5-4b5f-9aa5-190877fe0b12 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:25.711064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08578989-96a5-4b5f-9aa5-190877fe0b12 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:25.711168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08578989-96a5-4b5f-9aa5-190877fe0b12 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:25.712453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 635/1274] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:02:25.717671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d729a1e-4b45-4f8e-b941-4145dc2ea8f8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:25.718106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d729a1e-4b45-4f8e-b941-4145dc2ea8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:25.718246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d729a1e-4b45-4f8e-b941-4145dc2ea8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:25.736596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3d729a1e-4b45-4f8e-b941-4145dc2ea8f8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:25.737793 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3d729a1e-4b45-4f8e-b941-4145dc2ea8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:25.800740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 640/1275] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:02:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:02:26.068676 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08578989-96a5-4b5f-9aa5-190877fe0b12 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:26.167409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08578989-96a5-4b5f-9aa5-190877fe0b12 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:26.184336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:26.200682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d6e08-1b9c-4b3a-92ea-86b980add413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:26.201303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d6e08-1b9c-4b3a-92ea-86b980add413 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:26.201585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d6e08-1b9c-4b3a-92ea-86b980add413 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:26.201894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d6e08-1b9c-4b3a-92ea-86b980add413 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:26.211851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d6e08-1b9c-4b3a-92ea-86b980add413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-906d6e08-1b9c-4b3a-92ea-86b980add413 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 12:02:26.216690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:26.217986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:26.219066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 636/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 19 12:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:26.224028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d729a1e-4b45-4f8e-b941-4145dc2ea8f8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:26.303701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:26.321747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d729a1e-4b45-4f8e-b941-4145dc2ea8f8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:26.355162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba9745-079a-42c1-9a4d-0e9f053796f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:26.355795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba9745-079a-42c1-9a4d-0e9f053796f6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:26.356071 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba9745-079a-42c1-9a4d-0e9f053796f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:26.356416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba9745-079a-42c1-9a4d-0e9f053796f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:26.357134 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba9745-079a-42c1-9a4d-0e9f053796f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:26.357571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba9745-079a-42c1-9a4d-0e9f053796f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:26.359111 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba9745-079a-42c1-9a4d-0e9f053796f6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:26.368530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 641/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 19 12:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:26.374433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d6e08-1b9c-4b3a-92ea-86b980add413 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:26.483508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d6e08-1b9c-4b3a-92ea-86b980add413 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:26.518544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812d4df-f82a-4156-b83f-19b6da880e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:26.519171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812d4df-f82a-4156-b83f-19b6da880e6d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:26.519450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812d4df-f82a-4156-b83f-19b6da880e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:26.519720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812d4df-f82a-4156-b83f-19b6da880e6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:26.530037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812d4df-f82a-4156-b83f-19b6da880e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:26.531465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812d4df-f82a-4156-b83f-19b6da880e6d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5812d4df-f82a-4156-b83f-19b6da880e6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:26.546227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:26.547390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:26.548465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:26.548465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:26.548465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:26.548465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 637/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 12:02:26.553283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba9745-079a-42c1-9a4d-0e9f053796f6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:26.649303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba9745-079a-42c1-9a4d-0e9f053796f6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:26.681961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322686e2-f944-48b0-8f5a-706e5bcfdebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:26.682561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322686e2-f944-48b0-8f5a-706e5bcfdebf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:26.682838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322686e2-f944-48b0-8f5a-706e5bcfdebf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:26.683109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322686e2-f944-48b0-8f5a-706e5bcfdebf None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:26.683734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322686e2-f944-48b0-8f5a-706e5bcfdebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:26.684031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322686e2-f944-48b0-8f5a-706e5bcfdebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:26.685383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322686e2-f944-48b0-8f5a-706e5bcfdebf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:26.696609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 642/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:26.702324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812d4df-f82a-4156-b83f-19b6da880e6d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:26.732697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:26.798429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812d4df-f82a-4156-b83f-19b6da880e6d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:26.830480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250c699-9492-42ba-b907-94ff77d69561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:26.831082 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250c699-9492-42ba-b907-94ff77d69561 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:26.831358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250c699-9492-42ba-b907-94ff77d69561 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:26.831626 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250c699-9492-42ba-b907-94ff77d69561 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:26.839278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250c699-9492-42ba-b907-94ff77d69561 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:26.840698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250c699-9492-42ba-b907-94ff77d69561 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f250c699-9492-42ba-b907-94ff77d69561 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 12:02:26.851721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:26.852830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:26.853812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 638/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:26.858623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322686e2-f944-48b0-8f5a-706e5bcfdebf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:26.862424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:26.953338 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322686e2-f944-48b0-8f5a-706e5bcfdebf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:26.985884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5931d5-bc90-4944-b921-9f8f9e051b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:26.986475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5931d5-bc90-4944-b921-9f8f9e051b58 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:26.986754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5931d5-bc90-4944-b921-9f8f9e051b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:26.987024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5931d5-bc90-4944-b921-9f8f9e051b58 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:26.987730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5931d5-bc90-4944-b921-9f8f9e051b58 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:26.988035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5931d5-bc90-4944-b921-9f8f9e051b58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:26.989430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5931d5-bc90-4944-b921-9f8f9e051b58 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:27.006009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 643/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 19 12:02:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:27.011915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250c699-9492-42ba-b907-94ff77d69561 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:27.098253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:27.108278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250c699-9492-42ba-b907-94ff77d69561 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:27.140359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecfecf-5c03-4adb-a51a-31700561362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:27.140949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecfecf-5c03-4adb-a51a-31700561362d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:27.141226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecfecf-5c03-4adb-a51a-31700561362d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:27.141494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecfecf-5c03-4adb-a51a-31700561362d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:27.204518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecfecf-5c03-4adb-a51a-31700561362d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:27.205906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecfecf-5c03-4adb-a51a-31700561362d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:27.290519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:27.300694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 639/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 19 12:02:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 12:02:27.307215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5931d5-bc90-4944-b921-9f8f9e051b58 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:27.368827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:27.405383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5931d5-bc90-4944-b921-9f8f9e051b58 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:27.437407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff11d2e-f10c-4f7d-bb77-2b17c5591a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:27.438050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff11d2e-f10c-4f7d-bb77-2b17c5591a13 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:27.438330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff11d2e-f10c-4f7d-bb77-2b17c5591a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:27.438602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff11d2e-f10c-4f7d-bb77-2b17c5591a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:27.448786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff11d2e-f10c-4f7d-bb77-2b17c5591a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:27.450243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff11d2e-f10c-4f7d-bb77-2b17c5591a13 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6ff11d2e-f10c-4f7d-bb77-2b17c5591a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 12:02:27.464537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:27.465678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 12:02:27.466772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 12:02:27.466772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 12:02:27.466772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:27.466772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 644/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:27.471317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecfecf-5c03-4adb-a51a-31700561362d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:27.568044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecfecf-5c03-4adb-a51a-31700561362d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:27.602018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9604fc-1661-4d6c-952d-944030121ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:27.602612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9604fc-1661-4d6c-952d-944030121ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:27.602889 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9604fc-1661-4d6c-952d-944030121ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:27.603186 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9604fc-1661-4d6c-952d-944030121ba7 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:27.603814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9604fc-1661-4d6c-952d-944030121ba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:27.604141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9604fc-1661-4d6c-952d-944030121ba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:27.605515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9604fc-1661-4d6c-952d-944030121ba7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:27.616938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 640/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 19 12:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:02:27.622642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff11d2e-f10c-4f7d-bb77-2b17c5591a13 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:27.718540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff11d2e-f10c-4f7d-bb77-2b17c5591a13 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:27.731867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:27.751778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c55e5-8fea-49d1-964a-0c87e085c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:27.752393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c55e5-8fea-49d1-964a-0c87e085c7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:27.752667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c55e5-8fea-49d1-964a-0c87e085c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:27.752933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c55e5-8fea-49d1-964a-0c87e085c7d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:27.759470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c55e5-8fea-49d1-964a-0c87e085c7d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:27.760889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c55e5-8fea-49d1-964a-0c87e085c7d1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d43c55e5-8fea-49d1-964a-0c87e085c7d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 12:02:27.771815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:27.772864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:27.773802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 12:02:27.773802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 12:02:27.773802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 12:02:27.773802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 12:02:27.773802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 12:02:27.773802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 12:02:27.773802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 12:02:27.773802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Sep 19 12:02:27.773802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 645/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 19 12:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:27.778814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9604fc-1661-4d6c-952d-944030121ba7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:27.828478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:27.877985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9604fc-1661-4d6c-952d-944030121ba7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:27.910456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d79cf1-d8ca-4f1c-a959-7cbd0cc85027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:27.911051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d79cf1-d8ca-4f1c-a959-7cbd0cc85027 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:27.911333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d79cf1-d8ca-4f1c-a959-7cbd0cc85027 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:27.912202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d79cf1-d8ca-4f1c-a959-7cbd0cc85027 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:27.912920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d79cf1-d8ca-4f1c-a959-7cbd0cc85027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:27.913226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d79cf1-d8ca-4f1c-a959-7cbd0cc85027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:27.914672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d79cf1-d8ca-4f1c-a959-7cbd0cc85027 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:27.926167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 641/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 19 12:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:27.932268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c55e5-8fea-49d1-964a-0c87e085c7d1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:28.026979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c55e5-8fea-49d1-964a-0c87e085c7d1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:28.058681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ef3f8-778a-4b52-aa15-e1e2151f1986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:28.059260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ef3f8-778a-4b52-aa15-e1e2151f1986 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:28.059533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ef3f8-778a-4b52-aa15-e1e2151f1986 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:28.059798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ef3f8-778a-4b52-aa15-e1e2151f1986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:28.060497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ef3f8-778a-4b52-aa15-e1e2151f1986 None admin] RBAC: Adding query filter params (role.id=89abb13ee1e6498fa969c4a4f0332ba9, scope.project.id=799dfd7d80ef4359964b56a02315bf35, user.id=1aded088aa2a40e4b7fe024647ebfbed) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:28.060804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ef3f8-778a-4b52-aa15-e1e2151f1986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:28.062230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ef3f8-778a-4b52-aa15-e1e2151f1986 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:28.067661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 646/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 19 12:02:27 2022] GET /identity/v3/role_assignments?user.id=1aded088aa2a40e4b7fe024647ebfbed&scope.project.id=799dfd7d80ef4359964b56a02315bf35&role.id=89abb13ee1e6498fa969c4a4f0332ba9 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:30.202127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08c312-5a79-492f-bbc1-43b91bafddd4 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:30.202687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08c312-5a79-492f-bbc1-43b91bafddd4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:30.202687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08c312-5a79-492f-bbc1-43b91bafddd4 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:30.204011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 642/1288] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:02:30.209683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a395c-c2c3-4be3-ae53-ac1ac5761d6e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:30.210097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a395c-c2c3-4be3-ae53-ac1ac5761d6e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:30.210238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a395c-c2c3-4be3-ae53-ac1ac5761d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:30.228278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2b1a395c-c2c3-4be3-ae53-ac1ac5761d6e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:30.229453 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2b1a395c-c2c3-4be3-ae53-ac1ac5761d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:30.258466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:30.293826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 647/1289] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:02:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 12:02:30.563543 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08c312-5a79-492f-bbc1-43b91bafddd4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:30.663750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08c312-5a79-492f-bbc1-43b91bafddd4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:30.674679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:30.698598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b47b40-9033-4a48-90bc-05e7e00e3d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:30.699214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b47b40-9033-4a48-90bc-05e7e00e3d47 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:30.699492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b47b40-9033-4a48-90bc-05e7e00e3d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:30.699761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b47b40-9033-4a48-90bc-05e7e00e3d47 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:30.700332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b47b40-9033-4a48-90bc-05e7e00e3d47 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:30.701721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b47b40-9033-4a48-90bc-05e7e00e3d47 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-32b47b40-9033-4a48-90bc-05e7e00e3d47 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:30.710283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:30.711535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:30.712596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 643/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 19 12:02:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:30.717271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a395c-c2c3-4be3-ae53-ac1ac5761d6e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:30.813274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a395c-c2c3-4be3-ae53-ac1ac5761d6e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:30.845376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2967388-1cfd-4b13-b1d3-4c7015fa06ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:30.845942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2967388-1cfd-4b13-b1d3-4c7015fa06ec None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:30.846225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2967388-1cfd-4b13-b1d3-4c7015fa06ec None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:30.846498 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2967388-1cfd-4b13-b1d3-4c7015fa06ec None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:30.847122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2967388-1cfd-4b13-b1d3-4c7015fa06ec None admin] RBAC: Adding query filter params (name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:30.847430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2967388-1cfd-4b13-b1d3-4c7015fa06ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:30.849586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2967388-1cfd-4b13-b1d3-4c7015fa06ec None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:30.854322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 648/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Sep 19 12:02:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:30.859970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b47b40-9033-4a48-90bc-05e7e00e3d47 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:30.955946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b47b40-9033-4a48-90bc-05e7e00e3d47 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:30.988764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b0ce5-c914-43e4-bbea-f900f7f2f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:30.989352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b0ce5-c914-43e4-bbea-f900f7f2f460 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:30.989675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b0ce5-c914-43e4-bbea-f900f7f2f460 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:30.990123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b0ce5-c914-43e4-bbea-f900f7f2f460 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:30.990737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b0ce5-c914-43e4-bbea-f900f7f2f460 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:30.991037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b0ce5-c914-43e4-bbea-f900f7f2f460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:30.992376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b0ce5-c914-43e4-bbea-f900f7f2f460 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:30.996616 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 644/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Sep 19 12:02:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:33.113188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fa309-4b80-4d7b-9798-d9003a6da6e2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:33.113737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fa309-4b80-4d7b-9798-d9003a6da6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:33.113850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fa309-4b80-4d7b-9798-d9003a6da6e2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:33.115643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 649/1293] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:02:33.120776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8dda-d5e3-4167-9806-5069f8991a50 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:33.121170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8dda-d5e3-4167-9806-5069f8991a50 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:33.121369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8dda-d5e3-4167-9806-5069f8991a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:33.139530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a32f8dda-d5e3-4167-9806-5069f8991a50 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:33.140693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a32f8dda-d5e3-4167-9806-5069f8991a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:33.168392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:33.206657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 645/1294] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:02:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:02:33.487260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fa309-4b80-4d7b-9798-d9003a6da6e2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:33.518054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:33.586708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fa309-4b80-4d7b-9798-d9003a6da6e2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:33.619620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7978a9-1cbb-4c6e-9732-d1940caa1ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:33.620209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7978a9-1cbb-4c6e-9732-d1940caa1ba2 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:33.620484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7978a9-1cbb-4c6e-9732-d1940caa1ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:33.620750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7978a9-1cbb-4c6e-9732-d1940caa1ba2 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:33.621395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7978a9-1cbb-4c6e-9732-d1940caa1ba2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:33.622773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7978a9-1cbb-4c6e-9732-d1940caa1ba2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:33.636537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 650/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 19 12:02:33 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:02:35.792122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ae258-9866-4836-aeed-a4bfea3aed42 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:35.792647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ae258-9866-4836-aeed-a4bfea3aed42 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:35.792647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ae258-9866-4836-aeed-a4bfea3aed42 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:35.794058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 646/1296] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:02:35.799492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a51128-58d7-4b8b-81d4-1a9ccd2dc154 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:35.799931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a51128-58d7-4b8b-81d4-1a9ccd2dc154 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:35.800046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a51128-58d7-4b8b-81d4-1a9ccd2dc154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:35.818711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-49a51128-58d7-4b8b-81d4-1a9ccd2dc154 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:35.819916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-49a51128-58d7-4b8b-81d4-1a9ccd2dc154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:35.894221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 651/1297] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:02:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:02:36.168805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ae258-9866-4836-aeed-a4bfea3aed42 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:36.274682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ae258-9866-4836-aeed-a4bfea3aed42 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:36.306988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48be8-acfd-4e6e-bb3b-5cb60a828142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:36.307608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48be8-acfd-4e6e-bb3b-5cb60a828142 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:36.307883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48be8-acfd-4e6e-bb3b-5cb60a828142 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:36.308150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48be8-acfd-4e6e-bb3b-5cb60a828142 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:36.308717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c48be8-acfd-4e6e-bb3b-5cb60a828142 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:36.310097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c48be8-acfd-4e6e-bb3b-5cb60a828142 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-33c48be8-acfd-4e6e-bb3b-5cb60a828142 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:36.318714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:36.320073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:36.321212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 647/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 19 12:02:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:36.325814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a51128-58d7-4b8b-81d4-1a9ccd2dc154 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:36.344013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:36.428026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a51128-58d7-4b8b-81d4-1a9ccd2dc154 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:36.461149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945ad85-636f-45bf-8dd3-0d330f7bd908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:36.461774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ad85-636f-45bf-8dd3-0d330f7bd908 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:36.462058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ad85-636f-45bf-8dd3-0d330f7bd908 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:36.462328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ad85-636f-45bf-8dd3-0d330f7bd908 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:36.462943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ad85-636f-45bf-8dd3-0d330f7bd908 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:36.463244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ad85-636f-45bf-8dd3-0d330f7bd908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:36.464599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ad85-636f-45bf-8dd3-0d330f7bd908 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:36.469528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 652/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Sep 19 12:02:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:02:36.476820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48be8-acfd-4e6e-bb3b-5cb60a828142 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:36.508633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:36.575855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48be8-acfd-4e6e-bb3b-5cb60a828142 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:36.609029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62eff5-30cd-4f43-bdf9-3525cd6f628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:36.609645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62eff5-30cd-4f43-bdf9-3525cd6f628a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:36.609942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62eff5-30cd-4f43-bdf9-3525cd6f628a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:36.610215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62eff5-30cd-4f43-bdf9-3525cd6f628a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:36.610900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62eff5-30cd-4f43-bdf9-3525cd6f628a None admin] RBAC: Adding query filter params (interface=public, service_id=d7e18517f92b43a495c052d4ce86bb2e, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:36.611207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62eff5-30cd-4f43-bdf9-3525cd6f628a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:36.612565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62eff5-30cd-4f43-bdf9-3525cd6f628a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:36.617532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 648/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 19 12:02:36 2022] GET /identity/v3/endpoints?service_id=d7e18517f92b43a495c052d4ce86bb2e&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:36.623204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945ad85-636f-45bf-8dd3-0d330f7bd908 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:36.704469 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:36.722437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945ad85-636f-45bf-8dd3-0d330f7bd908 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:36.754584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550983-9ad2-43b6-a9e4-3c470e905300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:36.755705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550983-9ad2-43b6-a9e4-3c470e905300 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:36.755994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550983-9ad2-43b6-a9e4-3c470e905300 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:36.756262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550983-9ad2-43b6-a9e4-3c470e905300 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:36.756853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae550983-9ad2-43b6-a9e4-3c470e905300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:36.758240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae550983-9ad2-43b6-a9e4-3c470e905300 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:36.764667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 653/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 19 12:02:36 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:02:38.891368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb08542-3bd1-4ea8-a574-840406fbb027 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:38.891946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb08542-3bd1-4ea8-a574-840406fbb027 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:38.891946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb08542-3bd1-4ea8-a574-840406fbb027 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:38.893258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 649/1302] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:02:38.899553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df331c6d-de98-4d99-9733-ac3a7c5bcf88 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:38.900014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df331c6d-de98-4d99-9733-ac3a7c5bcf88 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:38.900124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df331c6d-de98-4d99-9733-ac3a7c5bcf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:38.918218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-df331c6d-de98-4d99-9733-ac3a7c5bcf88 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:38.919378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-df331c6d-de98-4d99-9733-ac3a7c5bcf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:38.983133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 654/1303] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:02:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 12:02:39.254427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb08542-3bd1-4ea8-a574-840406fbb027 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:39.348230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:39.355309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb08542-3bd1-4ea8-a574-840406fbb027 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:39.387951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f43f4-ab78-4a28-8308-9fa28c50386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:39.388568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f43f4-ab78-4a28-8308-9fa28c50386d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:39.388847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f43f4-ab78-4a28-8308-9fa28c50386d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:39.389119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f43f4-ab78-4a28-8308-9fa28c50386d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:39.389723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f43f4-ab78-4a28-8308-9fa28c50386d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:39.391078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f43f4-ab78-4a28-8308-9fa28c50386d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0b9f43f4-ab78-4a28-8308-9fa28c50386d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 12:02:39.399570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 12:02:39.400740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Sep 19 12:02:39.401797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 650/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 19 12:02:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 12:02:39.406703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df331c6d-de98-4d99-9733-ac3a7c5bcf88 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:39.480011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:39.503057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df331c6d-de98-4d99-9733-ac3a7c5bcf88 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:39.536063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4bc15-bd11-4848-8acf-871fd894821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:39.537395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4bc15-bd11-4848-8acf-871fd894821a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:39.537760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4bc15-bd11-4848-8acf-871fd894821a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:39.538041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4bc15-bd11-4848-8acf-871fd894821a None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:39.538663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4bc15-bd11-4848-8acf-871fd894821a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:39.538975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4bc15-bd11-4848-8acf-871fd894821a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:39.540332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4bc15-bd11-4848-8acf-871fd894821a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:39.545231 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 655/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Sep 19 12:02:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:02:39.551032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f43f4-ab78-4a28-8308-9fa28c50386d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:39.647010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f43f4-ab78-4a28-8308-9fa28c50386d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:39.680430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a7fdd-fc6d-492a-894c-2031c46e2256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:39.681026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a7fdd-fc6d-492a-894c-2031c46e2256 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:39.681301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a7fdd-fc6d-492a-894c-2031c46e2256 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:39.681572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a7fdd-fc6d-492a-894c-2031c46e2256 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:39.682251 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a7fdd-fc6d-492a-894c-2031c46e2256 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:39.683601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a7fdd-fc6d-492a-894c-2031c46e2256 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:39.702085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 651/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:02:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:02:49.542715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=30 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:49.697920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:43.578316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529d4bb-b0c2-431f-a238-bda0b8c2647d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:43.578911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529d4bb-b0c2-431f-a238-bda0b8c2647d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:43.578911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529d4bb-b0c2-431f-a238-bda0b8c2647d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:43.586420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e42d-27f1-43b0-9717-6aab9191d2ba None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:43.586884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e42d-27f1-43b0-9717-6aab9191d2ba None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:43.586966 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e42d-27f1-43b0-9717-6aab9191d2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:43.591642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 656/1307] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:03:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:03:43.715411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8046e42d-27f1-43b0-9717-6aab9191d2ba None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:43.716613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8046e42d-27f1-43b0-9717-6aab9191d2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:43.926312 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 652/1308] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:03:44.228177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54e85-3b57-43b2-b1cd-26d80118c969 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:44.228864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54e85-3b57-43b2-b1cd-26d80118c969 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:44.229376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54e85-3b57-43b2-b1cd-26d80118c969 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:44.231203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 657/1309] 10.222.0.50 () {54 vars in 963 bytes} [Mon Sep 19 12:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:03:44.243926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc556c-9e4e-4554-92ec-1fdcd086b480 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:44.244547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc556c-9e4e-4554-92ec-1fdcd086b480 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:44.245138 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc556c-9e4e-4554-92ec-1fdcd086b480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:44.331215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-64bc556c-9e4e-4554-92ec-1fdcd086b480 None None] MFA Rules not processed for user `4fe0dabaf0ef4fc7b417d378334413c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:44.332813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-64bc556c-9e4e-4554-92ec-1fdcd086b480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:44.363942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:44.439383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 653/1310] 10.222.0.50 () {58 vars in 1060 bytes} [Mon Sep 19 12:03:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:03:44.449287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54e85-3b57-43b2-b1cd-26d80118c969 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:03:44.451571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-52e54e85-3b57-43b2-b1cd-26d80118c969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:44.593557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54e85-3b57-43b2-b1cd-26d80118c969 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:03:44.688948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05c6fd-f75e-4d78-986d-42734572f35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:03:44.689562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05c6fd-f75e-4d78-986d-42734572f35c service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:44.689999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05c6fd-f75e-4d78-986d-42734572f35c service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:44.690275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05c6fd-f75e-4d78-986d-42734572f35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:44.691864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5f05c6fd-f75e-4d78-986d-42734572f35c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:44.751341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:44.813093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05c6fd-f75e-4d78-986d-42734572f35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:03:44.814685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05c6fd-f75e-4d78-986d-42734572f35c service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:03:44.835231 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 658/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:03:47.357957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e14a-c6e6-405c-8466-3f2d0d96f896 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:47.358440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e14a-c6e6-405c-8466-3f2d0d96f896 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:47.358642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e14a-c6e6-405c-8466-3f2d0d96f896 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:47.359930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 654/1312] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:03:47.365806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa239f-a5fd-456a-ba31-aec89646ad40 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:47.366221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa239f-a5fd-456a-ba31-aec89646ad40 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:47.366433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa239f-a5fd-456a-ba31-aec89646ad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:47.448559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5dfa239f-a5fd-456a-ba31-aec89646ad40 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:47.449793 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5dfa239f-a5fd-456a-ba31-aec89646ad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:47.545292 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 659/1313] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:03:47.839179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1e14a-c6e6-405c-8466-3f2d0d96f896 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:03:47.840777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6cc1e14a-c6e6-405c-8466-3f2d0d96f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:47.942215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1e14a-c6e6-405c-8466-3f2d0d96f896 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:03:48.011372 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:48.013716 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafac34d-a076-4740-bb1e-a2065e24192c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:03:48.014321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac34d-a076-4740-bb1e-a2065e24192c service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:48.014781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac34d-a076-4740-bb1e-a2065e24192c service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:48.015266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac34d-a076-4740-bb1e-a2065e24192c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:48.017066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fafac34d-a076-4740-bb1e-a2065e24192c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:48.122645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafac34d-a076-4740-bb1e-a2065e24192c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:03:48.124058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafac34d-a076-4740-bb1e-a2065e24192c service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:03:48.141528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 655/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:03:50.580186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036da57-d9e7-4832-9f81-71a83f8bd418 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:50.580767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036da57-d9e7-4832-9f81-71a83f8bd418 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:50.580767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036da57-d9e7-4832-9f81-71a83f8bd418 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:50.582180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 660/1315] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:03:50.588140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bcb7d-f880-4456-a6a9-5626a3b86396 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:50.588569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bcb7d-f880-4456-a6a9-5626a3b86396 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:50.588663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bcb7d-f880-4456-a6a9-5626a3b86396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:50.653811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bc3bcb7d-f880-4456-a6a9-5626a3b86396 None None] MFA Rules not processed for user `9b28b915296c4aa4a1eca58ed515da05`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:50.655004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bc3bcb7d-f880-4456-a6a9-5626a3b86396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:50.706042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:50.749838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 656/1316] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:03:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:03:51.031208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036da57-d9e7-4832-9f81-71a83f8bd418 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:03:51.032731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9036da57-d9e7-4832-9f81-71a83f8bd418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:51.042851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:51.135008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036da57-d9e7-4832-9f81-71a83f8bd418 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:03:51.205608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0b6f1-1c91-48ee-8f7c-ab9a45520180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:03:51.206223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0b6f1-1c91-48ee-8f7c-ab9a45520180 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:51.206501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0b6f1-1c91-48ee-8f7c-ab9a45520180 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:51.206774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0b6f1-1c91-48ee-8f7c-ab9a45520180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:51.208380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b8f0b6f1-1c91-48ee-8f7c-ab9a45520180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:51.268566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:51.315316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0b6f1-1c91-48ee-8f7c-ab9a45520180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:03:51.316739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0b6f1-1c91-48ee-8f7c-ab9a45520180 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:03:51.335664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 661/1317] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:03:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:03:54.016183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59aee4-176f-4e53-8221-c377b83834c8 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:54.016692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59aee4-176f-4e53-8221-c377b83834c8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:54.016692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59aee4-176f-4e53-8221-c377b83834c8 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:54.018001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 657/1318] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:03:54.023377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91ec75-4d91-4055-9175-330d4d7b2908 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:54.023803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91ec75-4d91-4055-9175-330d4d7b2908 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:54.023936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91ec75-4d91-4055-9175-330d4d7b2908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:54.088708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5d91ec75-4d91-4055-9175-330d4d7b2908 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:54.089909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5d91ec75-4d91-4055-9175-330d4d7b2908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:54.182704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 662/1319] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:03:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:03:54.470430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59aee4-176f-4e53-8221-c377b83834c8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:03:54.471946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9a59aee4-176f-4e53-8221-c377b83834c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:54.573527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59aee4-176f-4e53-8221-c377b83834c8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:03:54.644390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead3a99-44c9-45e8-856b-c30fafb0a0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:03:54.644980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3a99-44c9-45e8-856b-c30fafb0a0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:54.645904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3a99-44c9-45e8-856b-c30fafb0a0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:54.646218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3a99-44c9-45e8-856b-c30fafb0a0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:54.647807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0ead3a99-44c9-45e8-856b-c30fafb0a0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:54.654463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:54.753574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead3a99-44c9-45e8-856b-c30fafb0a0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:03:54.755563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead3a99-44c9-45e8-856b-c30fafb0a0b0 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:03:54.773787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 658/1320] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:03:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:03:57.587193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704243d-cd3d-468e-9d9a-3aabfc52f8c6 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:57.587758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704243d-cd3d-468e-9d9a-3aabfc52f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:57.587758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704243d-cd3d-468e-9d9a-3aabfc52f8c6 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:57.588990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 663/1321] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:03:57.594805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d5ff-cca6-4697-84bc-c7fcb0a0afc5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:57.595371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d5ff-cca6-4697-84bc-c7fcb0a0afc5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:57.595371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d5ff-cca6-4697-84bc-c7fcb0a0afc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:57.672709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5dc4d5ff-cca6-4697-84bc-c7fcb0a0afc5 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:57.673808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5dc4d5ff-cca6-4697-84bc-c7fcb0a0afc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:57.744290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:57.786751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 659/1322] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:03:58.073299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704243d-cd3d-468e-9d9a-3aabfc52f8c6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:03:58.074910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c704243d-cd3d-468e-9d9a-3aabfc52f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:58.094421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:58.177650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704243d-cd3d-468e-9d9a-3aabfc52f8c6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:03:58.251497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d4935-2a92-4b07-aeb0-b4038cda9fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:03:58.252120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d4935-2a92-4b07-aeb0-b4038cda9fbb service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:58.252403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d4935-2a92-4b07-aeb0-b4038cda9fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:58.252681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d4935-2a92-4b07-aeb0-b4038cda9fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:58.254361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d38d4935-2a92-4b07-aeb0-b4038cda9fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:58.326513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:58.366106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d4935-2a92-4b07-aeb0-b4038cda9fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:03:58.367547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d4935-2a92-4b07-aeb0-b4038cda9fbb service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:03:58.385525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 664/1323] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:00.616505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6cd76-8090-475f-9cea-b86ce08a66e5 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:00.617056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6cd76-8090-475f-9cea-b86ce08a66e5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:00.617153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6cd76-8090-475f-9cea-b86ce08a66e5 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:00.618472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 660/1324] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:00.624005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba650ba-eb86-4ea6-8bc7-6c61ceb13bd3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:00.624440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba650ba-eb86-4ea6-8bc7-6c61ceb13bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:00.624557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba650ba-eb86-4ea6-8bc7-6c61ceb13bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:00.698478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7ba650ba-eb86-4ea6-8bc7-6c61ceb13bd3 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:00.699679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7ba650ba-eb86-4ea6-8bc7-6c61ceb13bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:00.798524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 665/1325] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:01.090108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6cd76-8090-475f-9cea-b86ce08a66e5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:01.091730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bea6cd76-8090-475f-9cea-b86ce08a66e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:01.197531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6cd76-8090-475f-9cea-b86ce08a66e5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:01.273026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01a944-cd47-4997-badf-71db3b3982b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:01.273651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a944-cd47-4997-badf-71db3b3982b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:01.273930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a944-cd47-4997-badf-71db3b3982b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:01.274197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a944-cd47-4997-badf-71db3b3982b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:01.275763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fc01a944-cd47-4997-badf-71db3b3982b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:01.292717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:01.387694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01a944-cd47-4997-badf-71db3b3982b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:01.389145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01a944-cd47-4997-badf-71db3b3982b2 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:01.407224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 661/1326] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:03.638516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba26d-24c4-4187-8d10-d907bad9fd2e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:03.639150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba26d-24c4-4187-8d10-d907bad9fd2e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:03.639402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba26d-24c4-4187-8d10-d907bad9fd2e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:03.640747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 666/1327] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:03.646985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114bd26-8c3e-43ea-9d0c-7710b78ae93c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:03.647450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114bd26-8c3e-43ea-9d0c-7710b78ae93c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:03.647543 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114bd26-8c3e-43ea-9d0c-7710b78ae93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:03.719812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2114bd26-8c3e-43ea-9d0c-7710b78ae93c None None] MFA Rules not processed for user `9b28b915296c4aa4a1eca58ed515da05`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:03.721016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2114bd26-8c3e-43ea-9d0c-7710b78ae93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:03.787337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:03.819263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 662/1328] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:04.115062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b2599-2a3a-4e7b-973d-1c35d841e834 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:04.115347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b2599-2a3a-4e7b-973d-1c35d841e834 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:04.115617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b2599-2a3a-4e7b-973d-1c35d841e834 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:04.117446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 667/1329] 10.222.0.50 () {54 vars in 963 bytes} [Mon Sep 19 12:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:04.123729 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da8f4-2d4f-4af8-b53a-619a12f1193a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:04.124102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da8f4-2d4f-4af8-b53a-619a12f1193a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:04.124466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da8f4-2d4f-4af8-b53a-619a12f1193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:04.202891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ea1da8f4-2d4f-4af8-b53a-619a12f1193a None None] MFA Rules not processed for user `4fe0dabaf0ef4fc7b417d378334413c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:04.204026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ea1da8f4-2d4f-4af8-b53a-619a12f1193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:04.278059 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 663/1330] 10.222.0.50 () {58 vars in 1060 bytes} [Mon Sep 19 12:04:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:04.287708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b2599-2a3a-4e7b-973d-1c35d841e834 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:04.289218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f51b2599-2a3a-4e7b-973d-1c35d841e834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:04.320665 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:04.395797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b2599-2a3a-4e7b-973d-1c35d841e834 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:04.469681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026838ab-d908-49c9-8bda-633ebb2390cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:04.470180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026838ab-d908-49c9-8bda-633ebb2390cf service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:04.470462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026838ab-d908-49c9-8bda-633ebb2390cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:04.470736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026838ab-d908-49c9-8bda-633ebb2390cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:04.472315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-026838ab-d908-49c9-8bda-633ebb2390cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:04.551516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:04.584874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026838ab-d908-49c9-8bda-633ebb2390cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:04.586361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026838ab-d908-49c9-8bda-633ebb2390cf service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:04.605228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 668/1331] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:04:07.346513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f77776-8528-4401-8c50-8099b2cda230 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:07.347010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f77776-8528-4401-8c50-8099b2cda230 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:07.347115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f77776-8528-4401-8c50-8099b2cda230 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:07.348967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 664/1332] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:07.354556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d23442-0d7d-4442-879f-68bc3db68284 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:07.354956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d23442-0d7d-4442-879f-68bc3db68284 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:07.355103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d23442-0d7d-4442-879f-68bc3db68284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:07.419397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-45d23442-0d7d-4442-879f-68bc3db68284 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:07.420574 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-45d23442-0d7d-4442-879f-68bc3db68284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:07.513710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 669/1333] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:07.794381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f77776-8528-4401-8c50-8099b2cda230 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:07.795902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c6f77776-8528-4401-8c50-8099b2cda230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:07.866168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:07.899780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f77776-8528-4401-8c50-8099b2cda230 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:07.971350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5e5c8-8d0d-4b89-affe-f7a1b70fc332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:07.971882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5e5c8-8d0d-4b89-affe-f7a1b70fc332 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:07.972146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5e5c8-8d0d-4b89-affe-f7a1b70fc332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:07.972414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5e5c8-8d0d-4b89-affe-f7a1b70fc332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:07.975044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-85f5e5c8-8d0d-4b89-affe-f7a1b70fc332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:08.080800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5e5c8-8d0d-4b89-affe-f7a1b70fc332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:08.082250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5e5c8-8d0d-4b89-affe-f7a1b70fc332 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:08.091936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:08.100879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 665/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:10.296616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ca17-9495-4df8-a816-1ee4f5fbbd0d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:10.297201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ca17-9495-4df8-a816-1ee4f5fbbd0d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:10.297201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ca17-9495-4df8-a816-1ee4f5fbbd0d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:10.298551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 670/1335] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:10.303940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827cf05-ab8a-45c2-b0f0-ace2ad8e07a2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:10.304381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827cf05-ab8a-45c2-b0f0-ace2ad8e07a2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:10.304493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827cf05-ab8a-45c2-b0f0-ace2ad8e07a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:10.372864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5827cf05-ab8a-45c2-b0f0-ace2ad8e07a2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:10.374123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5827cf05-ab8a-45c2-b0f0-ace2ad8e07a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:10.469782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 666/1336] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:10.750962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ca17-9495-4df8-a816-1ee4f5fbbd0d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:10.752515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b271ca17-9495-4df8-a816-1ee4f5fbbd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:10.792925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:10.854510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ca17-9495-4df8-a816-1ee4f5fbbd0d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:10.926824 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb6246-d5ca-47d8-b602-196d0fee5c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:10.927353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb6246-d5ca-47d8-b602-196d0fee5c2f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:10.927630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb6246-d5ca-47d8-b602-196d0fee5c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:10.927903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb6246-d5ca-47d8-b602-196d0fee5c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:10.929606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dceb6246-d5ca-47d8-b602-196d0fee5c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:11.012241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:11.037874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb6246-d5ca-47d8-b602-196d0fee5c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:11.039281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb6246-d5ca-47d8-b602-196d0fee5c2f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:11.057108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 671/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:13.561792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3d27-ada6-4b7f-903c-22f190d9730a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:13.562321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3d27-ada6-4b7f-903c-22f190d9730a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:13.562321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3d27-ada6-4b7f-903c-22f190d9730a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:13.563819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 667/1338] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:13.569658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088978c7-9139-42b4-bd2a-1f8c1302d682 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:13.569658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088978c7-9139-42b4-bd2a-1f8c1302d682 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:13.569658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088978c7-9139-42b4-bd2a-1f8c1302d682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:13.639124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-088978c7-9139-42b4-bd2a-1f8c1302d682 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:13.640244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-088978c7-9139-42b4-bd2a-1f8c1302d682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:13.739567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 672/1339] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:14.019643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3d27-ada6-4b7f-903c-22f190d9730a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:14.021872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bfaf3d27-ada6-4b7f-903c-22f190d9730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:14.096172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:14.123395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3d27-ada6-4b7f-903c-22f190d9730a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:14.196268 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8b55-1485-4ae8-a089-42797405935b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:14.196824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8b55-1485-4ae8-a089-42797405935b service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:14.197098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8b55-1485-4ae8-a089-42797405935b service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:14.197366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8b55-1485-4ae8-a089-42797405935b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:14.198984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bc0d8b55-1485-4ae8-a089-42797405935b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:14.303392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d8b55-1485-4ae8-a089-42797405935b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:14.304816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d8b55-1485-4ae8-a089-42797405935b service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:14.324405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 668/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:18.454870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb041ffe-6ef4-45b8-8406-041a967fee4f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:18.455322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb041ffe-6ef4-45b8-8406-041a967fee4f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:18.455428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb041ffe-6ef4-45b8-8406-041a967fee4f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:18.456765 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 673/1341] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:18.462815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c145e-2ccf-4524-a8f7-98267bf45c5a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:18.463244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c145e-2ccf-4524-a8f7-98267bf45c5a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:18.463460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c145e-2ccf-4524-a8f7-98267bf45c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:18.469238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:18.532716 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9e2c145e-2ccf-4524-a8f7-98267bf45c5a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:18.534092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9e2c145e-2ccf-4524-a8f7-98267bf45c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:18.641985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 669/1342] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:18.932220 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb041ffe-6ef4-45b8-8406-041a967fee4f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:18.933891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fb041ffe-6ef4-45b8-8406-041a967fee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:18.982617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:19.038418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb041ffe-6ef4-45b8-8406-041a967fee4f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:19.110315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5934bd-6d09-454d-be74-d6d73480604a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:19.110913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5934bd-6d09-454d-be74-d6d73480604a service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:19.111188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5934bd-6d09-454d-be74-d6d73480604a service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:19.111455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5934bd-6d09-454d-be74-d6d73480604a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:19.113009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ac5934bd-6d09-454d-be74-d6d73480604a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:19.206771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:19.223968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5934bd-6d09-454d-be74-d6d73480604a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:19.225803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5934bd-6d09-454d-be74-d6d73480604a service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:19.243673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 674/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:22.064030 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7c98-fdec-4d80-aa45-275771b4c054 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:22.064560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7c98-fdec-4d80-aa45-275771b4c054 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:22.064560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7c98-fdec-4d80-aa45-275771b4c054 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:22.065948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 670/1344] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:22.071836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f062c-d6cc-41a2-980e-c50d5c569bd8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:22.072299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f062c-d6cc-41a2-980e-c50d5c569bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:22.072395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f062c-d6cc-41a2-980e-c50d5c569bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:22.137257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-979f062c-d6cc-41a2-980e-c50d5c569bd8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:22.138481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-979f062c-d6cc-41a2-980e-c50d5c569bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:22.234677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 675/1345] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:04:22.522940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e7c98-fdec-4d80-aa45-275771b4c054 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:22.524459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-489e7c98-fdec-4d80-aa45-275771b4c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:22.618593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:22.637638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e7c98-fdec-4d80-aa45-275771b4c054 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:22.718127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd05cd5-8ba9-4a8a-a847-b39467bb9471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:22.718675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05cd5-8ba9-4a8a-a847-b39467bb9471 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:22.718955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05cd5-8ba9-4a8a-a847-b39467bb9471 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:22.719224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05cd5-8ba9-4a8a-a847-b39467bb9471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:22.720811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8dd05cd5-8ba9-4a8a-a847-b39467bb9471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:22.835178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd05cd5-8ba9-4a8a-a847-b39467bb9471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:22.836629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd05cd5-8ba9-4a8a-a847-b39467bb9471 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:22.855796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 671/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:26.962984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aebba-5c7a-429e-88a6-f5f680f9b849 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:26.963427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aebba-5c7a-429e-88a6-f5f680f9b849 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:26.963528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aebba-5c7a-429e-88a6-f5f680f9b849 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:26.964908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 676/1347] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:26.970378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419ef39-9bec-450f-80b2-8dabcfe64f79 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:26.970871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419ef39-9bec-450f-80b2-8dabcfe64f79 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:26.971070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419ef39-9bec-450f-80b2-8dabcfe64f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:26.987398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:27.043087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f419ef39-9bec-450f-80b2-8dabcfe64f79 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:27.044239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f419ef39-9bec-450f-80b2-8dabcfe64f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:27.143183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 672/1348] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:27.426536 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aebba-5c7a-429e-88a6-f5f680f9b849 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:27.428342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c50aebba-5c7a-429e-88a6-f5f680f9b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:27.489900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:27.539180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aebba-5c7a-429e-88a6-f5f680f9b849 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:27.618120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24192cce-564d-49ac-83f3-babacac8d649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:27.618727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24192cce-564d-49ac-83f3-babacac8d649 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:27.619001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24192cce-564d-49ac-83f3-babacac8d649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:27.619271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24192cce-564d-49ac-83f3-babacac8d649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:27.621194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-24192cce-564d-49ac-83f3-babacac8d649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:27.726981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:27.730812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24192cce-564d-49ac-83f3-babacac8d649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:27.732255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24192cce-564d-49ac-83f3-babacac8d649 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:27.751050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 677/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:32.683480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319a527-03dc-4688-aeec-9fcbc7e1806e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:32.683909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319a527-03dc-4688-aeec-9fcbc7e1806e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:32.684017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319a527-03dc-4688-aeec-9fcbc7e1806e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:32.685359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 673/1350] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:32.691014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5bdf5-377e-4d78-8dff-a14d15b40a2b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:32.691493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5bdf5-377e-4d78-8dff-a14d15b40a2b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:32.691640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5bdf5-377e-4d78-8dff-a14d15b40a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:32.809008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d5e5bdf5-377e-4d78-8dff-a14d15b40a2b None None] MFA Rules not processed for user `1aded088aa2a40e4b7fe024647ebfbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:32.812264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d5e5bdf5-377e-4d78-8dff-a14d15b40a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:32.955191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 678/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:04:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:37.141631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=59 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:37.275456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c90ad-cfcb-4cf5-a71b-3d54c9bd8677 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:37.275808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c90ad-cfcb-4cf5-a71b-3d54c9bd8677 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:37.276048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c90ad-cfcb-4cf5-a71b-3d54c9bd8677 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:37.277518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 674/1352] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:37.282470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaca770-6732-4dcd-b48e-61230b622c63 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:37.282936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaca770-6732-4dcd-b48e-61230b622c63 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:37.283412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaca770-6732-4dcd-b48e-61230b622c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:37.339982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:37.367669 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ffaca770-6732-4dcd-b48e-61230b622c63 None None] MFA Rules not processed for user `1aded088aa2a40e4b7fe024647ebfbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:37.369016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ffaca770-6732-4dcd-b48e-61230b622c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:37.486537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 679/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:04:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:38.738000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52e4c-740b-4f93-bb51-62473c0d3cad None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:38.738507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52e4c-740b-4f93-bb51-62473c0d3cad None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:38.738588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52e4c-740b-4f93-bb51-62473c0d3cad None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:38.740018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 675/1354] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:38.744996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7caf-39c4-4025-a819-4403d271a48b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:38.745419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7caf-39c4-4025-a819-4403d271a48b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:38.745528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7caf-39c4-4025-a819-4403d271a48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:38.821841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-debc7caf-39c4-4025-a819-4403d271a48b None None] MFA Rules not processed for user `1aded088aa2a40e4b7fe024647ebfbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:38.823052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-debc7caf-39c4-4025-a819-4403d271a48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:38.864998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:38.930713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 680/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:04:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:04:42.681559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835344cf-d350-41fe-950e-a7205b906e06 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:42.682092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835344cf-d350-41fe-950e-a7205b906e06 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:42.682207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835344cf-d350-41fe-950e-a7205b906e06 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:42.683875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 676/1356] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:42.692075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4e60-cda2-4299-b865-fa4b2fd6f651 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:42.692565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4e60-cda2-4299-b865-fa4b2fd6f651 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:42.692803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4e60-cda2-4299-b865-fa4b2fd6f651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:42.765753 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-687b4e60-cda2-4299-b865-fa4b2fd6f651 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:42.766930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-687b4e60-cda2-4299-b865-fa4b2fd6f651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:42.879913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 681/1357] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:43.176814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ef5a-39c6-4082-a69a-383ff2153a10 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.177796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ef5a-39c6-4082-a69a-383ff2153a10 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.178818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ef5a-39c6-4082-a69a-383ff2153a10 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.181852 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 677/1358] 10.222.0.50 () {54 vars in 965 bytes} [Mon Sep 19 12:04:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:43.189817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc57e2-046c-41bd-886b-16de97d9a247 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.190118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc57e2-046c-41bd-886b-16de97d9a247 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.190375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc57e2-046c-41bd-886b-16de97d9a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.211243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:43.275388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-44cc57e2-046c-41bd-886b-16de97d9a247 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:43.276682 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-44cc57e2-046c-41bd-886b-16de97d9a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:43.405481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 682/1359] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Sep 19 12:04:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:43.414517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67ef5a-39c6-4082-a69a-383ff2153a10 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.416102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ab67ef5a-39c6-4082-a69a-383ff2153a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:43.569254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67ef5a-39c6-4082-a69a-383ff2153a10 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.643686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:43.689228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2338025-b70d-4456-8d6e-8c61f2d75f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.689839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2338025-b70d-4456-8d6e-8c61f2d75f68 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.690128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2338025-b70d-4456-8d6e-8c61f2d75f68 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.690421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2338025-b70d-4456-8d6e-8c61f2d75f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.692251 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c2338025-b70d-4456-8d6e-8c61f2d75f68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:43.792169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2338025-b70d-4456-8d6e-8c61f2d75f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.793802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2338025-b70d-4456-8d6e-8c61f2d75f68 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.813086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 678/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:46.229212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9b23d-1a3c-4f84-817a-5db3756c57a3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:46.230967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9b23d-1a3c-4f84-817a-5db3756c57a3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:46.230967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9b23d-1a3c-4f84-817a-5db3756c57a3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:46.231633 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 683/1361] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:46.236365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2a676-298a-4f32-9d04-591a8d6f714e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:46.236775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2a676-298a-4f32-9d04-591a8d6f714e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:46.236990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2a676-298a-4f32-9d04-591a8d6f714e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:46.305706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0be2a676-298a-4f32-9d04-591a8d6f714e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:46.306929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0be2a676-298a-4f32-9d04-591a8d6f714e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:46.345451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:46.413067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 679/1362] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:46.703639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9b23d-1a3c-4f84-817a-5db3756c57a3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:46.705531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e6e9b23d-1a3c-4f84-817a-5db3756c57a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:46.783456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:46.888612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9b23d-1a3c-4f84-817a-5db3756c57a3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:47.040850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b22a3-71f8-46dc-a34e-6306f19dcacb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:47.040850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b22a3-71f8-46dc-a34e-6306f19dcacb service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:47.040850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b22a3-71f8-46dc-a34e-6306f19dcacb service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:47.040850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b22a3-71f8-46dc-a34e-6306f19dcacb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:47.042561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ef8b22a3-71f8-46dc-a34e-6306f19dcacb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:47.067259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:47.136891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b22a3-71f8-46dc-a34e-6306f19dcacb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:47.138530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b22a3-71f8-46dc-a34e-6306f19dcacb service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:47.157349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 684/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:49.639777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51797a3-f19f-4619-ad4a-c4c5a5ca791d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.640379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51797a3-f19f-4619-ad4a-c4c5a5ca791d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.640379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51797a3-f19f-4619-ad4a-c4c5a5ca791d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.641830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 680/1364] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:49.647518 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e4cb-0075-4b6f-b18b-68ac7040a586 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.648025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e4cb-0075-4b6f-b18b-68ac7040a586 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.648121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e4cb-0075-4b6f-b18b-68ac7040a586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.722089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0016e4cb-0075-4b6f-b18b-68ac7040a586 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:49.724110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0016e4cb-0075-4b6f-b18b-68ac7040a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:49.825053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:49.832769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 685/1365] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:50.125024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9314330-0156-4ddc-bd77-2942935dc182 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:50.125470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9314330-0156-4ddc-bd77-2942935dc182 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:50.125995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9314330-0156-4ddc-bd77-2942935dc182 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:50.127484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 681/1366] 10.222.0.50 () {54 vars in 965 bytes} [Mon Sep 19 12:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:50.133380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad010b9-4a27-4d66-8d44-dab7313f15cb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:50.133960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad010b9-4a27-4d66-8d44-dab7313f15cb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:50.134410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad010b9-4a27-4d66-8d44-dab7313f15cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:50.221063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9ad010b9-4a27-4d66-8d44-dab7313f15cb None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:50.222779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9ad010b9-4a27-4d66-8d44-dab7313f15cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:50.343456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 686/1367] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Sep 19 12:04:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:50.351528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9314330-0156-4ddc-bd77-2942935dc182 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:50.353006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e9314330-0156-4ddc-bd77-2942935dc182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:50.505448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9314330-0156-4ddc-bd77-2942935dc182 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:50.528389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:50.629517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c369b-32dd-4379-9203-91a54fcd33f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:50.630123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c369b-32dd-4379-9203-91a54fcd33f4 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:50.630400 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c369b-32dd-4379-9203-91a54fcd33f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:50.630663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c369b-32dd-4379-9203-91a54fcd33f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:50.632242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-064c369b-32dd-4379-9203-91a54fcd33f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:50.737893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c369b-32dd-4379-9203-91a54fcd33f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:50.739595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c369b-32dd-4379-9203-91a54fcd33f4 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:50.759882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 682/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:50.978940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9185ac-ce80-4b4b-ac67-e7a2a61d8243 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:50.979495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9185ac-ce80-4b4b-ac67-e7a2a61d8243 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:50.979495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9185ac-ce80-4b4b-ac67-e7a2a61d8243 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:50.981000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 687/1369] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:50.986589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352797c-6ac2-46f3-92b3-7ad3478e514b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:50.986900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352797c-6ac2-46f3-92b3-7ad3478e514b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:50.987156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352797c-6ac2-46f3-92b3-7ad3478e514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:51.024639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:51.064957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4352797c-6ac2-46f3-92b3-7ad3478e514b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:51.066799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4352797c-6ac2-46f3-92b3-7ad3478e514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:51.175050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 683/1370] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:51.510890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d621f3-b037-4698-9525-8bff0c229776 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:51.511184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d621f3-b037-4698-9525-8bff0c229776 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:51.511467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d621f3-b037-4698-9525-8bff0c229776 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:51.512943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 688/1371] 10.222.0.50 () {54 vars in 967 bytes} [Mon Sep 19 12:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:51.517853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5916-af83-4707-a636-498c7f3ff4d3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:51.518223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5916-af83-4707-a636-498c7f3ff4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:51.518570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb5916-af83-4707-a636-498c7f3ff4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:51.603331 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a8eb5916-af83-4707-a636-498c7f3ff4d3 None None] MFA Rules not processed for user `c9cdd3fefd3f44eeaf19adbfac1ea13b`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:51.604571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a8eb5916-af83-4707-a636-498c7f3ff4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:51.661961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:51.696999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 684/1372] 10.222.0.50 () {58 vars in 1064 bytes} [Mon Sep 19 12:04:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:04:51.704603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d621f3-b037-4698-9525-8bff0c229776 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:51.706138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-14d621f3-b037-4698-9525-8bff0c229776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:51.763561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:51.824905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d621f3-b037-4698-9525-8bff0c229776 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:51.912104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc938c-bb35-4791-b9c4-d05b22a37ba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:51.912723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc938c-bb35-4791-b9c4-d05b22a37ba8 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:51.913003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc938c-bb35-4791-b9c4-d05b22a37ba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:51.913273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc938c-bb35-4791-b9c4-d05b22a37ba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:51.914927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4adc938c-bb35-4791-b9c4-d05b22a37ba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:52.068809 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:52.098108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc938c-bb35-4791-b9c4-d05b22a37ba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:52.101763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc938c-bb35-4791-b9c4-d05b22a37ba8 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:52.145251 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 689/1373] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:04:53.017141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3da62-b8bd-466c-b511-440035efbf35 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:53.017721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3da62-b8bd-466c-b511-440035efbf35 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:53.017721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3da62-b8bd-466c-b511-440035efbf35 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:53.019050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 685/1374] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:53.024214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2857d3-aa62-4b5b-8b90-d61f4d594a74 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:53.024500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2857d3-aa62-4b5b-8b90-d61f4d594a74 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:53.024772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2857d3-aa62-4b5b-8b90-d61f4d594a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:53.090494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4d2857d3-aa62-4b5b-8b90-d61f4d594a74 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:53.091795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4d2857d3-aa62-4b5b-8b90-d61f4d594a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:53.191283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 690/1375] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:53.481734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3da62-b8bd-466c-b511-440035efbf35 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:53.483273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-efb3da62-b8bd-466c-b511-440035efbf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:53.635677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3da62-b8bd-466c-b511-440035efbf35 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:53.695307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:53.766318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b71e9f-9ad9-4e45-a661-0be8d099027e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:53.766993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b71e9f-9ad9-4e45-a661-0be8d099027e service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:53.767302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b71e9f-9ad9-4e45-a661-0be8d099027e service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:53.767575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b71e9f-9ad9-4e45-a661-0be8d099027e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:53.769984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-66b71e9f-9ad9-4e45-a661-0be8d099027e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:53.866907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b71e9f-9ad9-4e45-a661-0be8d099027e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:53.868822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b71e9f-9ad9-4e45-a661-0be8d099027e service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:53.887440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 686/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:56.113480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20813e9-35f6-4cd5-b40c-31349797b016 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:56.114143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20813e9-35f6-4cd5-b40c-31349797b016 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:56.114143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20813e9-35f6-4cd5-b40c-31349797b016 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:56.115483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 691/1377] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:56.120633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c2320-cf6b-4fa5-83bf-4e8b332623e7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:56.121073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c2320-cf6b-4fa5-83bf-4e8b332623e7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:56.121169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c2320-cf6b-4fa5-83bf-4e8b332623e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:56.190375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-960c2320-cf6b-4fa5-83bf-4e8b332623e7 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:56.191831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-960c2320-cf6b-4fa5-83bf-4e8b332623e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:56.199180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:56.297573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 687/1378] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:56.584277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20813e9-35f6-4cd5-b40c-31349797b016 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:56.585856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e20813e9-35f6-4cd5-b40c-31349797b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:56.649454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:56.743111 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20813e9-35f6-4cd5-b40c-31349797b016 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:56.866853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeddf9-a780-4919-a679-9e445d6adbfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:56.867381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeddf9-a780-4919-a679-9e445d6adbfe service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:56.867660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeddf9-a780-4919-a679-9e445d6adbfe service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:56.867931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeddf9-a780-4919-a679-9e445d6adbfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:56.869507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dcaeddf9-a780-4919-a679-9e445d6adbfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:56.893333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:56.970597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeddf9-a780-4919-a679-9e445d6adbfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:56.972716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeddf9-a780-4919-a679-9e445d6adbfe service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:56.991795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 692/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:59.260486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025aaa-eaef-43f9-b1d8-6ca214b6b856 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.261078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025aaa-eaef-43f9-b1d8-6ca214b6b856 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.261078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025aaa-eaef-43f9-b1d8-6ca214b6b856 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.262552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 688/1380] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:04:59.267560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956c055-0813-40d6-9ea1-610ebd7ae634 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.267982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956c055-0813-40d6-9ea1-610ebd7ae634 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.268189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956c055-0813-40d6-9ea1-610ebd7ae634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.338833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b956c055-0813-40d6-9ea1-610ebd7ae634 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:59.340215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b956c055-0813-40d6-9ea1-610ebd7ae634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:59.439220 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:59.449659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 693/1381] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:59.746801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e025aaa-eaef-43f9-b1d8-6ca214b6b856 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.748356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5e025aaa-eaef-43f9-b1d8-6ca214b6b856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:59.898260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:59.908878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e025aaa-eaef-43f9-b1d8-6ca214b6b856 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:00.028242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094ad31-c016-449b-96ed-8de524b3ff9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:00.028876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ad31-c016-449b-96ed-8de524b3ff9f service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:00.029124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ad31-c016-449b-96ed-8de524b3ff9f service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:00.029393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ad31-c016-449b-96ed-8de524b3ff9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:00.031107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1094ad31-c016-449b-96ed-8de524b3ff9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:00.127973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094ad31-c016-449b-96ed-8de524b3ff9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:00.130579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094ad31-c016-449b-96ed-8de524b3ff9f service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:00.143226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:00.156030 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 689/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:05:02.362986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867a45b-c81c-4e93-b29e-7c8c719f5350 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:02.363797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867a45b-c81c-4e93-b29e-7c8c719f5350 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:02.363797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867a45b-c81c-4e93-b29e-7c8c719f5350 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:02.364863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 694/1383] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:02.370411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324b094-c6ab-4f1f-ae25-0cf5142facf7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:02.370957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324b094-c6ab-4f1f-ae25-0cf5142facf7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:02.370957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324b094-c6ab-4f1f-ae25-0cf5142facf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:02.440260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2324b094-c6ab-4f1f-ae25-0cf5142facf7 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:02.441771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2324b094-c6ab-4f1f-ae25-0cf5142facf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:02.544246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 690/1384] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:02.830744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867a45b-c81c-4e93-b29e-7c8c719f5350 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:02.833377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8867a45b-c81c-4e93-b29e-7c8c719f5350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:03.007982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867a45b-c81c-4e93-b29e-7c8c719f5350 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:03.095232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:03.154089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e3f23-3e37-445c-8faf-7b7b6ee3e218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:03.154826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e3f23-3e37-445c-8faf-7b7b6ee3e218 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:03.155165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e3f23-3e37-445c-8faf-7b7b6ee3e218 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:03.155511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e3f23-3e37-445c-8faf-7b7b6ee3e218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:03.157545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bd0e3f23-3e37-445c-8faf-7b7b6ee3e218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:03.271937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e3f23-3e37-445c-8faf-7b7b6ee3e218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:03.274035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e3f23-3e37-445c-8faf-7b7b6ee3e218 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:03.297534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 695/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:05.661947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022549b-0298-4301-8f81-6c0ac97f0d74 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:05.662448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022549b-0298-4301-8f81-6c0ac97f0d74 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:05.662448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022549b-0298-4301-8f81-6c0ac97f0d74 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:05.663796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 691/1386] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:05.669319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0eb1e-da06-4630-ac11-1c47c79f4cee None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:05.669851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0eb1e-da06-4630-ac11-1c47c79f4cee None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:05.669947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0eb1e-da06-4630-ac11-1c47c79f4cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:05.735803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b0e0eb1e-da06-4630-ac11-1c47c79f4cee None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:05.737069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b0e0eb1e-da06-4630-ac11-1c47c79f4cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:05.770612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:05.835898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 696/1387] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:06.124995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022549b-0298-4301-8f81-6c0ac97f0d74 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:06.126507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e022549b-0298-4301-8f81-6c0ac97f0d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:06.211124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:06.280158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022549b-0298-4301-8f81-6c0ac97f0d74 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:06.392920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ea23-9a10-4327-afcd-5cc51ba0a741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:06.393433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ea23-9a10-4327-afcd-5cc51ba0a741 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:06.394358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ea23-9a10-4327-afcd-5cc51ba0a741 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:06.394639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ea23-9a10-4327-afcd-5cc51ba0a741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:06.396214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1d96ea23-9a10-4327-afcd-5cc51ba0a741 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:06.434484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:06.486060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96ea23-9a10-4327-afcd-5cc51ba0a741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:06.487765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96ea23-9a10-4327-afcd-5cc51ba0a741 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:06.506225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 692/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:07.492512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f746-4b03-411c-ad0b-23e7db263b2a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:07.493065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f746-4b03-411c-ad0b-23e7db263b2a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:07.493065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f746-4b03-411c-ad0b-23e7db263b2a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:07.494423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 697/1389] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:07.499589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42c7e9-ca26-465c-b116-297bde923703 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:07.499985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42c7e9-ca26-465c-b116-297bde923703 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:07.500137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42c7e9-ca26-465c-b116-297bde923703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:07.566267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ea42c7e9-ca26-465c-b116-297bde923703 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:07.567468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ea42c7e9-ca26-465c-b116-297bde923703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:07.666811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 693/1390] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:07.970019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaaac6-4277-4f12-9cc2-0f228b951f88 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:07.970454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaaac6-4277-4f12-9cc2-0f228b951f88 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:07.970828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaaac6-4277-4f12-9cc2-0f228b951f88 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:07.972341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 698/1391] 10.222.0.50 () {54 vars in 962 bytes} [Mon Sep 19 12:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:07.978032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04899c24-0fa4-451b-b105-426e0eeb9662 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:07.978315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04899c24-0fa4-451b-b105-426e0eeb9662 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:07.978588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04899c24-0fa4-451b-b105-426e0eeb9662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:07.994404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:08.054906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-04899c24-0fa4-451b-b105-426e0eeb9662 None None] MFA Rules not processed for user `3f20fbf033f04036b48194a804dae8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:08.056188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-04899c24-0fa4-451b-b105-426e0eeb9662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:08.132826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 694/1392] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Sep 19 12:05:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:08.141872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaaac6-4277-4f12-9cc2-0f228b951f88 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:08.143360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4abaaac6-4277-4f12-9cc2-0f228b951f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:08.246963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaaac6-4277-4f12-9cc2-0f228b951f88 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:08.305396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:08.321083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de485f43-09da-4751-ae39-1857493cc469 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f20fbf033f04036b48194a804dae8c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:08.321717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485f43-09da-4751-ae39-1857493cc469 service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:08.322001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485f43-09da-4751-ae39-1857493cc469 service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:08.322269 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485f43-09da-4751-ae39-1857493cc469 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:08.323851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-de485f43-09da-4751-ae39-1857493cc469 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:08.462735 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de485f43-09da-4751-ae39-1857493cc469 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:08.464171 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de485f43-09da-4751-ae39-1857493cc469 service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:08.483732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 699/1393] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:08.726147 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d59bf9-3e9a-4b59-a870-da7423db114f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:08.726742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d59bf9-3e9a-4b59-a870-da7423db114f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:08.726742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d59bf9-3e9a-4b59-a870-da7423db114f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:08.728081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 695/1394] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:08.734025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c50ec-4c31-4ce0-ac18-c8a93a1439d1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:08.734582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c50ec-4c31-4ce0-ac18-c8a93a1439d1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:08.734689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c50ec-4c31-4ce0-ac18-c8a93a1439d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:08.804729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d00c50ec-4c31-4ce0-ac18-c8a93a1439d1 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:08.805949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d00c50ec-4c31-4ce0-ac18-c8a93a1439d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:08.852144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:08.917049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 700/1395] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:09.214287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d59bf9-3e9a-4b59-a870-da7423db114f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:09.215784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c8d59bf9-3e9a-4b59-a870-da7423db114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:09.234421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9d90-e016-4ee1-baff-2675f2c784a3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:09.234714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9d90-e016-4ee1-baff-2675f2c784a3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:09.235018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9d90-e016-4ee1-baff-2675f2c784a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:09.303572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b44b9d90-e016-4ee1-baff-2675f2c784a3 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:09.304794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b44b9d90-e016-4ee1-baff-2675f2c784a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:09.321529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:09.370639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d59bf9-3e9a-4b59-a870-da7423db114f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:09.395082 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 701/1396] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:05:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:05:09.442117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e0a6-7472-4ea8-a888-d76224250dd3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:09.442409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e0a6-7472-4ea8-a888-d76224250dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:09.442920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e0a6-7472-4ea8-a888-d76224250dd3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:09.444271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 702/1397] 10.222.0.50 () {54 vars in 943 bytes} [Mon Sep 19 12:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:09.450507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855eae1-99a0-4c10-a174-fe07f342401d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:09.450958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855eae1-99a0-4c10-a174-fe07f342401d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:09.451238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855eae1-99a0-4c10-a174-fe07f342401d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:09.491501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3de640-c3da-4967-bf58-c2d62ec587c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:09.492108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de640-c3da-4967-bf58-c2d62ec587c4 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:09.492388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de640-c3da-4967-bf58-c2d62ec587c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:09.492660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de640-c3da-4967-bf58-c2d62ec587c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:09.494297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e3de640-c3da-4967-bf58-c2d62ec587c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:09.496657 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:09.536318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1855eae1-99a0-4c10-a174-fe07f342401d None None] MFA Rules not processed for user `7b33b44f0e354c16846dd87179131141`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:09.537519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1855eae1-99a0-4c10-a174-fe07f342401d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:09.569153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:09.589576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3de640-c3da-4967-bf58-c2d62ec587c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:09.591210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3de640-c3da-4967-bf58-c2d62ec587c4 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:09.611444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 696/1398] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:09.647832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 703/1399] 10.222.0.50 () {58 vars in 1040 bytes} [Mon Sep 19 12:05:09 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:05:09.658078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3de640-c3da-4967-bf58-c2d62ec587c4 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:09.659918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e3de640-c3da-4967-bf58-c2d62ec587c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:09.759290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3de640-c3da-4967-bf58-c2d62ec587c4 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:09.873321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:09.874935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd930d4f-3b1a-4a00-8f2b-0da536115693 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:09.875540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd930d4f-3b1a-4a00-8f2b-0da536115693 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:09.875819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd930d4f-3b1a-4a00-8f2b-0da536115693 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:09.876103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd930d4f-3b1a-4a00-8f2b-0da536115693 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:09.879240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bd930d4f-3b1a-4a00-8f2b-0da536115693 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:09.963340 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd930d4f-3b1a-4a00-8f2b-0da536115693 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:09.964932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd930d4f-3b1a-4a00-8f2b-0da536115693 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:09.973933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 697/1400] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:05:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 12:05:11.869550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fbaad-31f2-43b8-93a2-756f50baa13f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:11.870172 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fbaad-31f2-43b8-93a2-756f50baa13f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:11.870172 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fbaad-31f2-43b8-93a2-756f50baa13f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:11.872735 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 704/1401] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:11.877036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd9c2f-6a41-4df9-9c7f-2633972e8672 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:11.877519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd9c2f-6a41-4df9-9c7f-2633972e8672 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:11.877648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd9c2f-6a41-4df9-9c7f-2633972e8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:11.951506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c4dd9c2f-6a41-4df9-9c7f-2633972e8672 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:11.952760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c4dd9c2f-6a41-4df9-9c7f-2633972e8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:12.056590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:12.065702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 698/1402] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:12.380188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fbaad-31f2-43b8-93a2-756f50baa13f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:12.382221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3f3fbaad-31f2-43b8-93a2-756f50baa13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:12.508240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:12.577446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fbaad-31f2-43b8-93a2-756f50baa13f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:12.714933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fead4b2-8bae-4f5d-baff-bd159ca2a23a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:12.715549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fead4b2-8bae-4f5d-baff-bd159ca2a23a service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:12.715832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fead4b2-8bae-4f5d-baff-bd159ca2a23a service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:12.716092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fead4b2-8bae-4f5d-baff-bd159ca2a23a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:12.717731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5fead4b2-8bae-4f5d-baff-bd159ca2a23a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:12.780502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:12.819980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fead4b2-8bae-4f5d-baff-bd159ca2a23a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:12.821580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fead4b2-8bae-4f5d-baff-bd159ca2a23a service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:12.841257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 705/1403] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:15.076523 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475241-943b-4c0f-b15b-4b4f0ae2d106 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.077117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475241-943b-4c0f-b15b-4b4f0ae2d106 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.077117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475241-943b-4c0f-b15b-4b4f0ae2d106 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.082350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 699/1404] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:05:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:15.083746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ecbfe-2d9d-4a0e-a00d-278b6982a6e7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.084167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ecbfe-2d9d-4a0e-a00d-278b6982a6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.084364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ecbfe-2d9d-4a0e-a00d-278b6982a6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.159345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-876ecbfe-2d9d-4a0e-a00d-278b6982a6e7 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:15.160719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-876ecbfe-2d9d-4a0e-a00d-278b6982a6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:15.271073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 706/1405] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:05:15.564156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a475241-943b-4c0f-b15b-4b4f0ae2d106 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.566711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0a475241-943b-4c0f-b15b-4b4f0ae2d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:15.750515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a475241-943b-4c0f-b15b-4b4f0ae2d106 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.820684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:15.874047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a81786-a16b-4321-be58-c97c3f2c2077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.874822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a81786-a16b-4321-be58-c97c3f2c2077 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.875197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a81786-a16b-4321-be58-c97c3f2c2077 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.875535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a81786-a16b-4321-be58-c97c3f2c2077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.877198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d4a81786-a16b-4321-be58-c97c3f2c2077 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:15.979078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a81786-a16b-4321-be58-c97c3f2c2077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.980587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a81786-a16b-4321-be58-c97c3f2c2077 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.999508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 700/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:18.291412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe285f-9e5d-4a4c-abab-4d8c05430288 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.292003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe285f-9e5d-4a4c-abab-4d8c05430288 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.292003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe285f-9e5d-4a4c-abab-4d8c05430288 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.293459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 707/1407] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 12:05:18.298979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59d75f-0b7b-49f0-b337-f4b8d02c4806 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.299436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59d75f-0b7b-49f0-b337-f4b8d02c4806 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.299539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59d75f-0b7b-49f0-b337-f4b8d02c4806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.373162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6c59d75f-0b7b-49f0-b337-f4b8d02c4806 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:18.374950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6c59d75f-0b7b-49f0-b337-f4b8d02c4806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:18.413396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:18.500978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 701/1408] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:18.795906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe285f-9e5d-4a4c-abab-4d8c05430288 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.797534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-debe285f-9e5d-4a4c-abab-4d8c05430288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:18.839564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:18.961660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe285f-9e5d-4a4c-abab-4d8c05430288 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:19.080205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:19.088612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bd60b-6b29-480e-a288-2d18e62590bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:19.088612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bd60b-6b29-480e-a288-2d18e62590bf service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:19.088893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bd60b-6b29-480e-a288-2d18e62590bf service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:19.088994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bd60b-6b29-480e-a288-2d18e62590bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:19.091647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e06bd60b-6b29-480e-a288-2d18e62590bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:19.194281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bd60b-6b29-480e-a288-2d18e62590bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:19.196584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bd60b-6b29-480e-a288-2d18e62590bf service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:19.217142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 708/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:28.499119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=30 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:29.214286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=48 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:32.472513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2206d-f814-411a-8a87-eadd08ae941a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:32.473089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2206d-f814-411a-8a87-eadd08ae941a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:32.473089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2206d-f814-411a-8a87-eadd08ae941a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:32.474455 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 702/1410] 10.222.0.50 () {54 vars in 918 bytes} [Mon Sep 19 12:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:32.479887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0e28-d3c9-4c0f-9ac8-a509246c7655 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:32.480289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0e28-d3c9-4c0f-9ac8-a509246c7655 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:32.480437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0e28-d3c9-4c0f-9ac8-a509246c7655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:32.555167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-335d0e28-d3c9-4c0f-9ac8-a509246c7655 None None] MFA Rules not processed for user `1aded088aa2a40e4b7fe024647ebfbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:32.556358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-335d0e28-d3c9-4c0f-9ac8-a509246c7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:32.658449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 709/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Sep 19 12:05:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:32.673961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c21d-70fd-439b-a16f-def6da96fec4 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:32.674249 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c21d-70fd-439b-a16f-def6da96fec4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:32.675020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c21d-70fd-439b-a16f-def6da96fec4 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:32.676336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 703/1412] 10.222.0.50 () {54 vars in 918 bytes} [Mon Sep 19 12:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:32.680962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2869764-4093-4bd2-955a-88369985808b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:32.681251 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2869764-4093-4bd2-955a-88369985808b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:32.681524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2869764-4093-4bd2-955a-88369985808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:32.754527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:32.757510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c2869764-4093-4bd2-955a-88369985808b None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:32.759276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c2869764-4093-4bd2-955a-88369985808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:32.873634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 710/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Sep 19 12:05:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:35.462748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc25c5-2487-48b6-90ac-ec6797071050 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:35.463277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc25c5-2487-48b6-90ac-ec6797071050 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:35.463277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc25c5-2487-48b6-90ac-ec6797071050 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:35.464674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:35.470046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7c503-bc03-4bb5-8372-95c58b2bc84b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:35.470491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7c503-bc03-4bb5-8372-95c58b2bc84b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:35.470617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7c503-bc03-4bb5-8372-95c58b2bc84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:35.539379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e3c7c503-bc03-4bb5-8372-95c58b2bc84b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:35.540570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e3c7c503-bc03-4bb5-8372-95c58b2bc84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:35.593334 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:35.635337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:35.928407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc25c5-2487-48b6-90ac-ec6797071050 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:35.930175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-56dc25c5-2487-48b6-90ac-ec6797071050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:36.073766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc25c5-2487-48b6-90ac-ec6797071050 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:36.145991 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:36.185607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79710050-234f-48eb-a327-66e74b77a205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:36.186158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710050-234f-48eb-a327-66e74b77a205 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:36.186433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710050-234f-48eb-a327-66e74b77a205 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:36.186703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710050-234f-48eb-a327-66e74b77a205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:36.188284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79710050-234f-48eb-a327-66e74b77a205 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:36.277316 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79710050-234f-48eb-a327-66e74b77a205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:36.278939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79710050-234f-48eb-a327-66e74b77a205 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:36.296635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 705/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:37.435933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e14d-926c-4bb2-9c65-b64115543d49 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:37.436374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e14d-926c-4bb2-9c65-b64115543d49 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:37.436467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e14d-926c-4bb2-9c65-b64115543d49 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:37.437837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:37.444494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d46d1-342b-4cb7-a8b6-bb1ff9db193e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:37.444930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d46d1-342b-4cb7-a8b6-bb1ff9db193e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:37.445045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d46d1-342b-4cb7-a8b6-bb1ff9db193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:37.519547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e62d46d1-342b-4cb7-a8b6-bb1ff9db193e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:37.520755 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e62d46d1-342b-4cb7-a8b6-bb1ff9db193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:37.547079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:37.618628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:37.771486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e14d-926c-4bb2-9c65-b64115543d49 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:37.773000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fae3e14d-926c-4bb2-9c65-b64115543d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:37.916995 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e14d-926c-4bb2-9c65-b64115543d49 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:37.957274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:38.030361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac11e0-1e62-4b93-906c-30833d2b9acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:38.030960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac11e0-1e62-4b93-906c-30833d2b9acf service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:38.031237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac11e0-1e62-4b93-906c-30833d2b9acf service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:38.031508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac11e0-1e62-4b93-906c-30833d2b9acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:38.033077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a3ac11e0-1e62-4b93-906c-30833d2b9acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:38.119058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac11e0-1e62-4b93-906c-30833d2b9acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:38.120619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac11e0-1e62-4b93-906c-30833d2b9acf service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:38.138565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 713/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:39.276306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a43af5-5c80-473f-8d86-39a2a269bca1 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:39.276847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a43af5-5c80-473f-8d86-39a2a269bca1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:39.276971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a43af5-5c80-473f-8d86-39a2a269bca1 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:39.278353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:39.285236 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6c48b-d95d-42d7-ada3-e489e264295d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:39.285671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6c48b-d95d-42d7-ada3-e489e264295d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:39.285823 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6c48b-d95d-42d7-ada3-e489e264295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:39.339755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:39.362060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-35d6c48b-d95d-42d7-ada3-e489e264295d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:39.363270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-35d6c48b-d95d-42d7-ada3-e489e264295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:39.466027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:39.621962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a43af5-5c80-473f-8d86-39a2a269bca1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:39.623508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-12a43af5-5c80-473f-8d86-39a2a269bca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:39.767663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a43af5-5c80-473f-8d86-39a2a269bca1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:39.779533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:39.882612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844cc66-bef7-4f57-91f8-87c200a1f720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:39.883129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844cc66-bef7-4f57-91f8-87c200a1f720 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:39.883409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844cc66-bef7-4f57-91f8-87c200a1f720 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:39.883690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844cc66-bef7-4f57-91f8-87c200a1f720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:39.885312 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e844cc66-bef7-4f57-91f8-87c200a1f720 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:39.974084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844cc66-bef7-4f57-91f8-87c200a1f720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:39.975916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844cc66-bef7-4f57-91f8-87c200a1f720 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:39.993818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 708/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:41.155229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a4db-5795-4ef2-ae3f-749b63886696 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:41.155804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a4db-5795-4ef2-ae3f-749b63886696 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:41.155804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a4db-5795-4ef2-ae3f-749b63886696 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:41.157141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:41.164901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601663e-1496-4f11-aed2-70cb5e20a5a8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:41.165687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601663e-1496-4f11-aed2-70cb5e20a5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:41.165687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601663e-1496-4f11-aed2-70cb5e20a5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:41.190177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:41.254011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f601663e-1496-4f11-aed2-70cb5e20a5a8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:41.255248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f601663e-1496-4f11-aed2-70cb5e20a5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:41.358290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:41.509490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a4db-5795-4ef2-ae3f-749b63886696 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:41.510947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f3d9a4db-5795-4ef2-ae3f-749b63886696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:41.620803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:41.656625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a4db-5795-4ef2-ae3f-749b63886696 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:41.770058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214794e0-ee92-4fca-8023-746a9b77d88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:41.770611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214794e0-ee92-4fca-8023-746a9b77d88b service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:41.770891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214794e0-ee92-4fca-8023-746a9b77d88b service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:41.771163 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214794e0-ee92-4fca-8023-746a9b77d88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:41.772761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-214794e0-ee92-4fca-8023-746a9b77d88b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:41.849366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:41.863529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214794e0-ee92-4fca-8023-746a9b77d88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:41.865129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214794e0-ee92-4fca-8023-746a9b77d88b service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:41.883023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 716/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:43.001076 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d960720-f01d-4779-9df4-2cfc111bbcbc None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:43.001590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d960720-f01d-4779-9df4-2cfc111bbcbc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:43.001590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d960720-f01d-4779-9df4-2cfc111bbcbc None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:43.003526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:43.009786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9ad9a-d430-4f4e-a0f3-e53a437f5785 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:43.010211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9ad9a-d430-4f4e-a0f3-e53a437f5785 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:43.010337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9ad9a-d430-4f4e-a0f3-e53a437f5785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:43.085600 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-05a9ad9a-d430-4f4e-a0f3-e53a437f5785 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:43.086844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-05a9ad9a-d430-4f4e-a0f3-e53a437f5785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:43.189543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:43.341213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d960720-f01d-4779-9df4-2cfc111bbcbc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:43.342764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6d960720-f01d-4779-9df4-2cfc111bbcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:43.427028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:43.488529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d960720-f01d-4779-9df4-2cfc111bbcbc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:43.600268 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b168e-73a7-4e52-8939-4c33baa5838b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:43.601050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b168e-73a7-4e52-8939-4c33baa5838b service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:43.601323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b168e-73a7-4e52-8939-4c33baa5838b service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:43.601587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b168e-73a7-4e52-8939-4c33baa5838b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:43.603208 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-220b168e-73a7-4e52-8939-4c33baa5838b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:43.650859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:43.692199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b168e-73a7-4e52-8939-4c33baa5838b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:43.693833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b168e-73a7-4e52-8939-4c33baa5838b service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:43.712029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 711/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:44.790530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d1385-2ef2-491f-be86-667eaeb42589 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:44.791083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d1385-2ef2-491f-be86-667eaeb42589 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:44.791083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d1385-2ef2-491f-be86-667eaeb42589 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:44.792394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:44.798666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dcb6f-1b2d-4fef-8fef-4d772aeeccbb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:44.799746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dcb6f-1b2d-4fef-8fef-4d772aeeccbb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:44.799920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dcb6f-1b2d-4fef-8fef-4d772aeeccbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:44.874936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d78dcb6f-1b2d-4fef-8fef-4d772aeeccbb None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:44.876093 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d78dcb6f-1b2d-4fef-8fef-4d772aeeccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:44.970236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:45.120581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d1385-2ef2-491f-be86-667eaeb42589 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:45.122100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a51d1385-2ef2-491f-be86-667eaeb42589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:45.170428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:45.264032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d1385-2ef2-491f-be86-667eaeb42589 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:45.378837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97840e-a139-4917-9a95-72a7e66fe5b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:45.379440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97840e-a139-4917-9a95-72a7e66fe5b6 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:45.379714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97840e-a139-4917-9a95-72a7e66fe5b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:45.379981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97840e-a139-4917-9a95-72a7e66fe5b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:45.381599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ae97840e-a139-4917-9a95-72a7e66fe5b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:45.388555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:45.473393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97840e-a139-4917-9a95-72a7e66fe5b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:45.474937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97840e-a139-4917-9a95-72a7e66fe5b6 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:45.492595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 719/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:46.545129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb86d-ecaf-45f9-9688-f78c2a614d1f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:46.545713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb86d-ecaf-45f9-9688-f78c2a614d1f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:46.545713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb86d-ecaf-45f9-9688-f78c2a614d1f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:46.547035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:46.553222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46185-581a-4e7a-85ff-c3894040118d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:46.553668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46185-581a-4e7a-85ff-c3894040118d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:46.553798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46185-581a-4e7a-85ff-c3894040118d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:46.629672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-38a46185-581a-4e7a-85ff-c3894040118d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:46.630897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-38a46185-581a-4e7a-85ff-c3894040118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:46.697578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:46.727424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:46.875343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdb86d-ecaf-45f9-9688-f78c2a614d1f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:46.876846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aecdb86d-ecaf-45f9-9688-f78c2a614d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:46.894574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:47.020196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdb86d-ecaf-45f9-9688-f78c2a614d1f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:47.105109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:47.131106 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ed57-a36a-413c-a912-266bddcae5db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:47.131632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ed57-a36a-413c-a912-266bddcae5db service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:47.131904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ed57-a36a-413c-a912-266bddcae5db service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:47.132170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ed57-a36a-413c-a912-266bddcae5db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:47.133768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cc99ed57-a36a-413c-a912-266bddcae5db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:47.220480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99ed57-a36a-413c-a912-266bddcae5db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:47.222599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99ed57-a36a-413c-a912-266bddcae5db service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:47.241067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 714/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:48.299523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb6703-ede6-4199-8ec1-4ccbdb338044 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:48.300234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb6703-ede6-4199-8ec1-4ccbdb338044 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:48.300234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb6703-ede6-4199-8ec1-4ccbdb338044 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:48.301407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:48.307511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4704fc-adce-4ef7-8db7-eaf5cb34bfc3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:48.307979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4704fc-adce-4ef7-8db7-eaf5cb34bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:48.308087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4704fc-adce-4ef7-8db7-eaf5cb34bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:48.382767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0c4704fc-adce-4ef7-8db7-eaf5cb34bfc3 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:48.383960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0c4704fc-adce-4ef7-8db7-eaf5cb34bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:48.424446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:48.482051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:48.631907 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb6703-ede6-4199-8ec1-4ccbdb338044 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:48.633454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6ccb6703-ede6-4199-8ec1-4ccbdb338044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:48.779170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb6703-ede6-4199-8ec1-4ccbdb338044 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:48.834158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:48.892948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b5743-6b66-4397-a9c6-ef25307688a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:48.893482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b5743-6b66-4397-a9c6-ef25307688a1 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:48.893795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b5743-6b66-4397-a9c6-ef25307688a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:48.894074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b5743-6b66-4397-a9c6-ef25307688a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:48.895664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-584b5743-6b66-4397-a9c6-ef25307688a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:48.984863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b5743-6b66-4397-a9c6-ef25307688a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:48.987027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b5743-6b66-4397-a9c6-ef25307688a1 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:49.005163 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 722/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:50.047030 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28add90-180a-4f1c-9a5f-56cf5ef94d5a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:50.047554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28add90-180a-4f1c-9a5f-56cf5ef94d5a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:50.047554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28add90-180a-4f1c-9a5f-56cf5ef94d5a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:50.048885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:50.055312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ef592-97c8-4006-881c-aed6085a7b1c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:50.055726 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ef592-97c8-4006-881c-aed6085a7b1c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:50.055890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ef592-97c8-4006-881c-aed6085a7b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:50.131096 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-803ef592-97c8-4006-881c-aed6085a7b1c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:50.132294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-803ef592-97c8-4006-881c-aed6085a7b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:50.134355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:50.228801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:50.378517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28add90-180a-4f1c-9a5f-56cf5ef94d5a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:50.380015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d28add90-180a-4f1c-9a5f-56cf5ef94d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:50.526178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28add90-180a-4f1c-9a5f-56cf5ef94d5a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:50.556845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:50.643694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d266295-d3de-4b35-a745-df1429c93bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:50.644205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266295-d3de-4b35-a745-df1429c93bc2 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:50.644478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266295-d3de-4b35-a745-df1429c93bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:50.644754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266295-d3de-4b35-a745-df1429c93bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:50.646485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2d266295-d3de-4b35-a745-df1429c93bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:50.734489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d266295-d3de-4b35-a745-df1429c93bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:50.736085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d266295-d3de-4b35-a745-df1429c93bc2 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:50.755577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 717/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:52.801125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd7b42-9649-4509-b871-ffd355200801 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:52.801713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd7b42-9649-4509-b871-ffd355200801 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:52.801713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd7b42-9649-4509-b871-ffd355200801 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:52.803021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 12:05:52.808258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15a336-69ac-4247-8558-2a25125f1834 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:52.808700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15a336-69ac-4247-8558-2a25125f1834 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:52.808808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15a336-69ac-4247-8558-2a25125f1834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:52.848630 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:52.874212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cd15a336-69ac-4247-8558-2a25125f1834 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:52.875400 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cd15a336-69ac-4247-8558-2a25125f1834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:52.973384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:53.260197 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd7b42-9649-4509-b871-ffd355200801 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:53.261750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-69cd7b42-9649-4509-b871-ffd355200801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:53.365794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd7b42-9649-4509-b871-ffd355200801 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:53.397533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:53.439137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60c74b-f343-4fc0-9edb-126c532774f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:53.440401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60c74b-f343-4fc0-9edb-126c532774f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:53.440675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60c74b-f343-4fc0-9edb-126c532774f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:53.440954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60c74b-f343-4fc0-9edb-126c532774f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:53.442563 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2d60c74b-f343-4fc0-9edb-126c532774f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:53.665648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60c74b-f343-4fc0-9edb-126c532774f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:53.667102 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60c74b-f343-4fc0-9edb-126c532774f1 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:53.686104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 725/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:55.985728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8edc5-4c43-4f90-92a6-5663081d5715 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:55.986236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8edc5-4c43-4f90-92a6-5663081d5715 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:55.986236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8edc5-4c43-4f90-92a6-5663081d5715 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:55.987683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:55.993022 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cb519-247c-4826-a09b-cdc39a528c68 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:55.993428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cb519-247c-4826-a09b-cdc39a528c68 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:55.993593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cb519-247c-4826-a09b-cdc39a528c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:56.058263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ab7cb519-247c-4826-a09b-cdc39a528c68 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:56.059449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ab7cb519-247c-4826-a09b-cdc39a528c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:56.072275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:56.154572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:56.438002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8edc5-4c43-4f90-92a6-5663081d5715 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:56.440364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f6b8edc5-4c43-4f90-92a6-5663081d5715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:56.542889 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8edc5-4c43-4f90-92a6-5663081d5715 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:56.555986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:56.615641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2483f4-d00f-45f7-9fe1-b7f3a997ac46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:56.616238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2483f4-d00f-45f7-9fe1-b7f3a997ac46 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:56.616515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2483f4-d00f-45f7-9fe1-b7f3a997ac46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:56.616786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2483f4-d00f-45f7-9fe1-b7f3a997ac46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:56.618402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9b2483f4-d00f-45f7-9fe1-b7f3a997ac46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:56.726773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2483f4-d00f-45f7-9fe1-b7f3a997ac46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:56.728173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2483f4-d00f-45f7-9fe1-b7f3a997ac46 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:56.746081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 720/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:59.204847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b187e-a5e2-4931-a9fc-a24d294cea63 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:59.205467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b187e-a5e2-4931-a9fc-a24d294cea63 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:59.205614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b187e-a5e2-4931-a9fc-a24d294cea63 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:59.206854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:05:59.212204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1f5e7-0618-4e8e-9ab1-2d0de0dc2b00 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:59.212635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1f5e7-0618-4e8e-9ab1-2d0de0dc2b00 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:59.212775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1f5e7-0618-4e8e-9ab1-2d0de0dc2b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:59.260070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:59.278081 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-edd1f5e7-0618-4e8e-9ab1-2d0de0dc2b00 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:59.279303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-edd1f5e7-0618-4e8e-9ab1-2d0de0dc2b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:59.376715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:59.661064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b187e-a5e2-4931-a9fc-a24d294cea63 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:59.662668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fa3b187e-a5e2-4931-a9fc-a24d294cea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:59.767029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b187e-a5e2-4931-a9fc-a24d294cea63 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:59.807126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:59.841348 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68bfa1-72c4-47b9-9eec-101847f964eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:59.841971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bfa1-72c4-47b9-9eec-101847f964eb service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:59.842246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bfa1-72c4-47b9-9eec-101847f964eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:59.842520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bfa1-72c4-47b9-9eec-101847f964eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:59.844074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cb68bfa1-72c4-47b9-9eec-101847f964eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:59.951418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68bfa1-72c4-47b9-9eec-101847f964eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:59.952776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68bfa1-72c4-47b9-9eec-101847f964eb service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:59.970257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 728/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:02.249230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ff76e-7d97-4b42-8de1-60d597a54403 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:02.249815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ff76e-7d97-4b42-8de1-60d597a54403 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:02.249815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ff76e-7d97-4b42-8de1-60d597a54403 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:02.251189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:02.256463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dfa6b-006b-45c1-9c32-665c3000b0c1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:02.256886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dfa6b-006b-45c1-9c32-665c3000b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:02.257017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dfa6b-006b-45c1-9c32-665c3000b0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:02.322020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1e6dfa6b-006b-45c1-9c32-665c3000b0c1 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:02.323217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1e6dfa6b-006b-45c1-9c32-665c3000b0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:02.343804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:02.420706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:02.708413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ff76e-7d97-4b42-8de1-60d597a54403 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:02.709987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-060ff76e-7d97-4b42-8de1-60d597a54403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:02.813210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ff76e-7d97-4b42-8de1-60d597a54403 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:02.834358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:02.887174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdba81-a85e-45fd-90a1-4b9cb1a33e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:02.887778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdba81-a85e-45fd-90a1-4b9cb1a33e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:02.888057 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdba81-a85e-45fd-90a1-4b9cb1a33e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:02.888335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdba81-a85e-45fd-90a1-4b9cb1a33e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:02.889972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a8fdba81-a85e-45fd-90a1-4b9cb1a33e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:02.998308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdba81-a85e-45fd-90a1-4b9cb1a33e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:02.999666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdba81-a85e-45fd-90a1-4b9cb1a33e8c service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:03.017709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 723/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:05.215140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b8b7f-6719-45be-9a18-180a9f07d9db None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:05.215705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b8b7f-6719-45be-9a18-180a9f07d9db None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:05.215705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b8b7f-6719-45be-9a18-180a9f07d9db None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:05.216998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:05.222485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf8d39-ee80-4776-a2eb-335bd2ee35cb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:05.222928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf8d39-ee80-4776-a2eb-335bd2ee35cb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:05.223025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf8d39-ee80-4776-a2eb-335bd2ee35cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:05.285508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:05.288152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0cdf8d39-ee80-4776-a2eb-335bd2ee35cb None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:05.290013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0cdf8d39-ee80-4776-a2eb-335bd2ee35cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:05.383788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:06:05.667958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b8b7f-6719-45be-9a18-180a9f07d9db None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:05.669532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-695b8b7f-6719-45be-9a18-180a9f07d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:05.770803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b8b7f-6719-45be-9a18-180a9f07d9db None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:05.819723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:05.843373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c411e3-3957-491b-9ada-4aa910e9b498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:05.843969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c411e3-3957-491b-9ada-4aa910e9b498 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:05.844244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c411e3-3957-491b-9ada-4aa910e9b498 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:05.844515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c411e3-3957-491b-9ada-4aa910e9b498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:05.846734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-53c411e3-3957-491b-9ada-4aa910e9b498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:05.953424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c411e3-3957-491b-9ada-4aa910e9b498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:05.954812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c411e3-3957-491b-9ada-4aa910e9b498 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:05.973281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 731/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:08.187470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1d70b-859f-4728-a76a-4031166e40ed None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:08.188041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1d70b-859f-4728-a76a-4031166e40ed None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:08.188041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1d70b-859f-4728-a76a-4031166e40ed None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:08.189402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:08.195064 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ea30-d045-467f-b80a-7a965e0fbca9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:08.195497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ea30-d045-467f-b80a-7a965e0fbca9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:08.195618 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ea30-d045-467f-b80a-7a965e0fbca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:08.259958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b1e4ea30-d045-467f-b80a-7a965e0fbca9 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:08.261149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b1e4ea30-d045-467f-b80a-7a965e0fbca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:08.289691 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:08.355566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:06:08.643631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1d70b-859f-4728-a76a-4031166e40ed None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:08.645191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-47c1d70b-859f-4728-a76a-4031166e40ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:08.748709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1d70b-859f-4728-a76a-4031166e40ed None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:08.778125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:08.823513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea3b75-70fe-4403-85fb-84616c8e691c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:08.824115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea3b75-70fe-4403-85fb-84616c8e691c service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:08.824394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea3b75-70fe-4403-85fb-84616c8e691c service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:08.824665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea3b75-70fe-4403-85fb-84616c8e691c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:08.826377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-16ea3b75-70fe-4403-85fb-84616c8e691c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:08.935660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea3b75-70fe-4403-85fb-84616c8e691c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:08.937012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea3b75-70fe-4403-85fb-84616c8e691c service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:08.956276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 726/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:11.168989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7df98-325e-4ceb-aea5-3f74ddde802b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:11.169535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7df98-325e-4ceb-aea5-3f74ddde802b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:11.169535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7df98-325e-4ceb-aea5-3f74ddde802b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:11.170924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:11.176939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1fab-0d0e-47d9-a721-8e99df20de7a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:11.177371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1fab-0d0e-47d9-a721-8e99df20de7a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:11.177516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1fab-0d0e-47d9-a721-8e99df20de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:11.243160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-62dc1fab-0d0e-47d9-a721-8e99df20de7a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:11.244355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-62dc1fab-0d0e-47d9-a721-8e99df20de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:11.252422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:11.340429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:11.623427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7df98-325e-4ceb-aea5-3f74ddde802b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:11.624939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-69b7df98-325e-4ceb-aea5-3f74ddde802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:11.728346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7df98-325e-4ceb-aea5-3f74ddde802b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:11.783092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:11.800384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6125b8-7118-4631-8300-dee7a10b6d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:11.800986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6125b8-7118-4631-8300-dee7a10b6d08 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:11.801261 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6125b8-7118-4631-8300-dee7a10b6d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:11.801529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6125b8-7118-4631-8300-dee7a10b6d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:11.803127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6f6125b8-7118-4631-8300-dee7a10b6d08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:11.909157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6125b8-7118-4631-8300-dee7a10b6d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:11.910589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6125b8-7118-4631-8300-dee7a10b6d08 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:11.928223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 734/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:14.206823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd49286-e143-488c-a6d4-e65ca59f6a00 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:14.207375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd49286-e143-488c-a6d4-e65ca59f6a00 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:14.207375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd49286-e143-488c-a6d4-e65ca59f6a00 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:14.208670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:14.213916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa7ef-e663-4ef3-bc41-76eb9247262d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:14.214354 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa7ef-e663-4ef3-bc41-76eb9247262d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:14.214469 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa7ef-e663-4ef3-bc41-76eb9247262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:14.279888 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-25bfa7ef-e663-4ef3-bc41-76eb9247262d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:14.281086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-25bfa7ef-e663-4ef3-bc41-76eb9247262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:14.321099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:14.380349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:06:14.677144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd49286-e143-488c-a6d4-e65ca59f6a00 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:14.678702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3fd49286-e143-488c-a6d4-e65ca59f6a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:14.780148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd49286-e143-488c-a6d4-e65ca59f6a00 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:14.817611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:14.854042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc9752-558a-437f-8a39-346992423718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:14.854644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9752-558a-437f-8a39-346992423718 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:14.854919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9752-558a-437f-8a39-346992423718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:14.855189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9752-558a-437f-8a39-346992423718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:14.856795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8bcc9752-558a-437f-8a39-346992423718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:14.965117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc9752-558a-437f-8a39-346992423718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:14.966491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc9752-558a-437f-8a39-346992423718 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:14.984263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 729/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:17.149030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1859c-b0e6-45a9-95f1-3ce8ad31c911 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:17.149642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1859c-b0e6-45a9-95f1-3ce8ad31c911 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:17.149642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1859c-b0e6-45a9-95f1-3ce8ad31c911 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:17.150949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:17.156471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9caf2-baf7-4311-babd-4f50889641c0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:17.156896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9caf2-baf7-4311-babd-4f50889641c0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:17.157011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9caf2-baf7-4311-babd-4f50889641c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:17.222950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f9b9caf2-baf7-4311-babd-4f50889641c0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:17.224171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f9b9caf2-baf7-4311-babd-4f50889641c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:17.242414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:17.318505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:17.598468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1859c-b0e6-45a9-95f1-3ce8ad31c911 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:17.599987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e7b1859c-b0e6-45a9-95f1-3ce8ad31c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:17.701740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1859c-b0e6-45a9-95f1-3ce8ad31c911 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:17.769056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:17.775817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05600004-dcce-4f4e-a2ab-22f5f265e8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:17.776421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05600004-dcce-4f4e-a2ab-22f5f265e8ad service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:17.776699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05600004-dcce-4f4e-a2ab-22f5f265e8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:17.776966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05600004-dcce-4f4e-a2ab-22f5f265e8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:17.778594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-05600004-dcce-4f4e-a2ab-22f5f265e8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:17.885515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05600004-dcce-4f4e-a2ab-22f5f265e8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:17.886982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05600004-dcce-4f4e-a2ab-22f5f265e8ad service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:17.904686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 737/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:06:20.067449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565193b-9a6e-4260-bf21-93f8ec6ee836 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:20.068001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565193b-9a6e-4260-bf21-93f8ec6ee836 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:20.068001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565193b-9a6e-4260-bf21-93f8ec6ee836 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:20.069352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:20.074758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea285cc-2a73-47e4-9df9-47df85e74cd2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:20.075183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea285cc-2a73-47e4-9df9-47df85e74cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:20.075284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea285cc-2a73-47e4-9df9-47df85e74cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:20.139406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5ea285cc-2a73-47e4-9df9-47df85e74cd2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:20.140615 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5ea285cc-2a73-47e4-9df9-47df85e74cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:20.192194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:20.239966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:20.525638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565193b-9a6e-4260-bf21-93f8ec6ee836 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:20.527199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8565193b-9a6e-4260-bf21-93f8ec6ee836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:20.634737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565193b-9a6e-4260-bf21-93f8ec6ee836 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:20.686966 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:20.712938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add5ddb-5b4a-4df7-91c2-4dff9d45b93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:20.713541 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add5ddb-5b4a-4df7-91c2-4dff9d45b93d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:20.713850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add5ddb-5b4a-4df7-91c2-4dff9d45b93d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:20.714126 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add5ddb-5b4a-4df7-91c2-4dff9d45b93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:20.715714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5add5ddb-5b4a-4df7-91c2-4dff9d45b93d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:20.823365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add5ddb-5b4a-4df7-91c2-4dff9d45b93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:20.824798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add5ddb-5b4a-4df7-91c2-4dff9d45b93d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:20.843034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 732/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:30.238474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=22 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:30.840757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=66 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:40.769901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede64e-d25b-4a2e-ae45-4fc205219ed6 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:40.770579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede64e-d25b-4a2e-ae45-4fc205219ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:40.770579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede64e-d25b-4a2e-ae45-4fc205219ed6 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:40.772259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 739/1471] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:40.777353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b1b32-e05b-4fab-aa93-6f737b4e3453 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:40.777809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b1b32-e05b-4fab-aa93-6f737b4e3453 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:40.777899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b1b32-e05b-4fab-aa93-6f737b4e3453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:40.846848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-106b1b32-e05b-4fab-aa93-6f737b4e3453 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:40.848068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-106b1b32-e05b-4fab-aa93-6f737b4e3453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:40.953913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 733/1472] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:41.300194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa458c91-8095-4cb7-9f5b-5c257cb98941 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:41.300472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa458c91-8095-4cb7-9f5b-5c257cb98941 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:41.302687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa458c91-8095-4cb7-9f5b-5c257cb98941 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:41.304021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 740/1473] 10.222.0.50 () {54 vars in 962 bytes} [Mon Sep 19 12:06:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:41.309168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f229f-bdd4-449d-8c8b-9315361c33c7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:41.309454 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f229f-bdd4-449d-8c8b-9315361c33c7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:41.309759 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f229f-bdd4-449d-8c8b-9315361c33c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:41.389794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d20f229f-bdd4-449d-8c8b-9315361c33c7 None None] MFA Rules not processed for user `3f20fbf033f04036b48194a804dae8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:41.391010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d20f229f-bdd4-449d-8c8b-9315361c33c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:41.412067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:41.466574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 734/1474] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Sep 19 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:41.474763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa458c91-8095-4cb7-9f5b-5c257cb98941 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:41.476584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-aa458c91-8095-4cb7-9f5b-5c257cb98941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:41.578569 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa458c91-8095-4cb7-9f5b-5c257cb98941 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:41.663829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0301f-8904-4902-858b-687da2db249f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f20fbf033f04036b48194a804dae8c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:41.664438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0301f-8904-4902-858b-687da2db249f service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:41.664716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0301f-8904-4902-858b-687da2db249f service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:41.664987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0301f-8904-4902-858b-687da2db249f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:41.666600 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3cc0301f-8904-4902-858b-687da2db249f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:41.721862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:41.777047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0301f-8904-4902-858b-687da2db249f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:41.778502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0301f-8904-4902-858b-687da2db249f service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:41.796424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 741/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:44.052463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104a5bc-c2dc-4475-a957-f6f3f7ef3fb1 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:44.053026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104a5bc-c2dc-4475-a957-f6f3f7ef3fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:44.053026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104a5bc-c2dc-4475-a957-f6f3f7ef3fb1 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:44.054371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 735/1476] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:44.059615 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880301d-6bf5-4e34-af7c-b5656b815506 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:44.060023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880301d-6bf5-4e34-af7c-b5656b815506 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:44.060221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880301d-6bf5-4e34-af7c-b5656b815506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:44.125091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0880301d-6bf5-4e34-af7c-b5656b815506 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:44.126818 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0880301d-6bf5-4e34-af7c-b5656b815506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:44.221756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 742/1477] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:44.499254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104a5bc-c2dc-4475-a957-f6f3f7ef3fb1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:44.500705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2104a5bc-c2dc-4475-a957-f6f3f7ef3fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:44.627675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104a5bc-c2dc-4475-a957-f6f3f7ef3fb1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:44.678155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:44.722851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a137c-6966-45d3-9d47-4dc58a3a5380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:44.723453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a137c-6966-45d3-9d47-4dc58a3a5380 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:44.723732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a137c-6966-45d3-9d47-4dc58a3a5380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:44.724002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a137c-6966-45d3-9d47-4dc58a3a5380 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:44.724664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a137c-6966-45d3-9d47-4dc58a3a5380 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:44.726764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-ee7a137c-6966-45d3-9d47-4dc58a3a5380 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:06:44.726764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: warnings.warn(msg) Sep 19 12:06:44.726764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: Sep 19 12:06:44.727901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a137c-6966-45d3-9d47-4dc58a3a5380 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:44.747007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 736/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 19 12:06:44 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:06:46.919412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac6f2d-b652-408f-9193-f3ec3c54692e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:46.919988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac6f2d-b652-408f-9193-f3ec3c54692e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:46.919988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac6f2d-b652-408f-9193-f3ec3c54692e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:46.921306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 743/1479] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:46.927753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1029-33d1-4213-8327-98ca00d794f0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:46.928232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1029-33d1-4213-8327-98ca00d794f0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:46.928232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1029-33d1-4213-8327-98ca00d794f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:46.993761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3b8a1029-33d1-4213-8327-98ca00d794f0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:46.994963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3b8a1029-33d1-4213-8327-98ca00d794f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:47.088513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 737/1480] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:47.384281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac6f2d-b652-408f-9193-f3ec3c54692e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:47.385823 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-90ac6f2d-b652-408f-9193-f3ec3c54692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:47.396502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:47.529362 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac6f2d-b652-408f-9193-f3ec3c54692e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:47.608488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:47.641729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c184778-c4a0-4a64-b128-ff4109051fa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:47.642264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c184778-c4a0-4a64-b128-ff4109051fa9 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:47.642541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c184778-c4a0-4a64-b128-ff4109051fa9 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:47.642808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c184778-c4a0-4a64-b128-ff4109051fa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:47.644372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3c184778-c4a0-4a64-b128-ff4109051fa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:47.732612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c184778-c4a0-4a64-b128-ff4109051fa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:47.734217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c184778-c4a0-4a64-b128-ff4109051fa9 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:47.752317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 744/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:50.086384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6b1d8-32a9-49c9-a22a-23211c0a54ff None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:50.086944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6b1d8-32a9-49c9-a22a-23211c0a54ff None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:50.086944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6b1d8-32a9-49c9-a22a-23211c0a54ff None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:50.088332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 738/1482] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:50.093685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9b5e-e8b9-486d-bec1-41947978aa0e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:50.094086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9b5e-e8b9-486d-bec1-41947978aa0e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:50.094227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9b5e-e8b9-486d-bec1-41947978aa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:50.159407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7b7c9b5e-e8b9-486d-bec1-41947978aa0e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:50.160625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7b7c9b5e-e8b9-486d-bec1-41947978aa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:50.206482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:50.255774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 745/1483] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:06:50.545865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6b1d8-32a9-49c9-a22a-23211c0a54ff None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:50.547420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9bc6b1d8-32a9-49c9-a22a-23211c0a54ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:50.571960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:50.649754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6b1d8-32a9-49c9-a22a-23211c0a54ff None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:50.725036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0647e24-b816-4404-9dcd-c181d06832b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:50.725656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647e24-b816-4404-9dcd-c181d06832b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:50.725937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647e24-b816-4404-9dcd-c181d06832b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:50.726459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647e24-b816-4404-9dcd-c181d06832b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:50.728028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c0647e24-b816-4404-9dcd-c181d06832b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:50.802567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:50.837343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0647e24-b816-4404-9dcd-c181d06832b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:50.838879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0647e24-b816-4404-9dcd-c181d06832b8 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:50.858172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 739/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:53.057020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f056125-36a7-46c4-9b58-87a564e86b3d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:53.057540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f056125-36a7-46c4-9b58-87a564e86b3d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:53.057811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f056125-36a7-46c4-9b58-87a564e86b3d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:53.058978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 746/1485] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:53.064807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781952-dda9-4cfd-8e7d-d3cbf88b288c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:53.065230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781952-dda9-4cfd-8e7d-d3cbf88b288c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:53.065346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781952-dda9-4cfd-8e7d-d3cbf88b288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:53.131781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-82781952-dda9-4cfd-8e7d-d3cbf88b288c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:53.133003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-82781952-dda9-4cfd-8e7d-d3cbf88b288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:53.228213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 740/1486] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:53.520264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f056125-36a7-46c4-9b58-87a564e86b3d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:53.521823 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6f056125-36a7-46c4-9b58-87a564e86b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:53.623234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f056125-36a7-46c4-9b58-87a564e86b3d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:53.694867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:53.696420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e39dd-349b-43f6-a521-a1dd8344965f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:53.697081 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e39dd-349b-43f6-a521-a1dd8344965f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:53.697548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e39dd-349b-43f6-a521-a1dd8344965f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:53.698033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e39dd-349b-43f6-a521-a1dd8344965f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:53.699827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fd3e39dd-349b-43f6-a521-a1dd8344965f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:53.807544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e39dd-349b-43f6-a521-a1dd8344965f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:53.808988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e39dd-349b-43f6-a521-a1dd8344965f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:53.826303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 747/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:56.187515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c9fb-e369-42ee-b479-a5c416e2c17c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:56.188632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c9fb-e369-42ee-b479-a5c416e2c17c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:56.188632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c9fb-e369-42ee-b479-a5c416e2c17c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:56.190358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 741/1488] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:56.195798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1ff80-8980-4fe2-ba01-ad4d5faa1cd0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:56.196243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1ff80-8980-4fe2-ba01-ad4d5faa1cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:56.196360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1ff80-8980-4fe2-ba01-ad4d5faa1cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:56.260923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cda1ff80-8980-4fe2-ba01-ad4d5faa1cd0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:56.262151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cda1ff80-8980-4fe2-ba01-ad4d5faa1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:56.314006 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:56.358808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 748/1489] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:56.655033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638c9fb-e369-42ee-b479-a5c416e2c17c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:56.656557 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1638c9fb-e369-42ee-b479-a5c416e2c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:56.693771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:56.761819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638c9fb-e369-42ee-b479-a5c416e2c17c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:56.834240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84218e-1731-42f3-af44-36282d895dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:56.834848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84218e-1731-42f3-af44-36282d895dfb service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:56.835122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84218e-1731-42f3-af44-36282d895dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:56.835393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84218e-1731-42f3-af44-36282d895dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:56.836968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ca84218e-1731-42f3-af44-36282d895dfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:56.916518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:56.945808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84218e-1731-42f3-af44-36282d895dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:56.947248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84218e-1731-42f3-af44-36282d895dfb service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:56.965247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 742/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:59.292949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f988-f45b-41cc-a3c5-ee3d8dd652bf None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:59.293527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f988-f45b-41cc-a3c5-ee3d8dd652bf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:59.293527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f988-f45b-41cc-a3c5-ee3d8dd652bf None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:59.294891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 749/1491] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 19 12:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:06:59.301294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd0f72-a53b-44e0-8769-7dddd7e36d38 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:59.301722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd0f72-a53b-44e0-8769-7dddd7e36d38 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:59.301896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd0f72-a53b-44e0-8769-7dddd7e36d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:59.366890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-29fd0f72-a53b-44e0-8769-7dddd7e36d38 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:59.368102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-29fd0f72-a53b-44e0-8769-7dddd7e36d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:59.467475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 743/1492] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 19 12:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:59.757381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451f988-f45b-41cc-a3c5-ee3d8dd652bf None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:59.758967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6451f988-f45b-41cc-a3c5-ee3d8dd652bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:59.860568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451f988-f45b-41cc-a3c5-ee3d8dd652bf None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:59.933225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109861a0-89d0-4f8a-9bb2-604b3bcfb04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:59.933781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109861a0-89d0-4f8a-9bb2-604b3bcfb04f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:59.934055 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109861a0-89d0-4f8a-9bb2-604b3bcfb04f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:59.934323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109861a0-89d0-4f8a-9bb2-604b3bcfb04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:59.935890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-109861a0-89d0-4f8a-9bb2-604b3bcfb04f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:59.944735 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:00.044621 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109861a0-89d0-4f8a-9bb2-604b3bcfb04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:00.046085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109861a0-89d0-4f8a-9bb2-604b3bcfb04f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:00.064859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 750/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:07:09.465947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=82 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:10.061909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=50 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:12.668169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f1cde-621e-4b29-a0f3-7078988de890 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:12.668715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f1cde-621e-4b29-a0f3-7078988de890 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:12.668715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f1cde-621e-4b29-a0f3-7078988de890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:12.746747 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f60f1cde-621e-4b29-a0f3-7078988de890 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:12.747945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f60f1cde-621e-4b29-a0f3-7078988de890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:12.842052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 744/1494] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:12.850044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a13e-80ea-470a-88ff-e79cb3b03479 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:12.850530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a13e-80ea-470a-88ff-e79cb3b03479 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:12.850631 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a13e-80ea-470a-88ff-e79cb3b03479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:12.925570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3851a13e-80ea-470a-88ff-e79cb3b03479 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:12.926709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3851a13e-80ea-470a-88ff-e79cb3b03479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:13.021211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 751/1495] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:13.025805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f1cde-621e-4b29-a0f3-7078988de890 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:13.027001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f60f1cde-621e-4b29-a0f3-7078988de890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:13.038334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f1cde-621e-4b29-a0f3-7078988de890 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:13.099098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:13.136695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:13.137307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:13.137648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:13.138044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:13.138714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:08:13.139016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:13.140029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:08:13.140029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: warnings.warn(msg) Sep 19 12:08:13.140029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: Sep 19 12:08:13.140914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:13.151996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 745/1496] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:08:13.160715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851a13e-80ea-470a-88ff-e79cb3b03479 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:13.169565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851a13e-80ea-470a-88ff-e79cb3b03479 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:13.237073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:13.270151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05b2b8-131e-4e88-89e6-4169c7485163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:13.270748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b2b8-131e-4e88-89e6-4169c7485163 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:13.271021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b2b8-131e-4e88-89e6-4169c7485163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:13.271284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b2b8-131e-4e88-89e6-4169c7485163 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:13.271898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05b2b8-131e-4e88-89e6-4169c7485163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:13.273608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-ac05b2b8-131e-4e88-89e6-4169c7485163 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:08:13.273608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: warnings.warn(msg) Sep 19 12:08:13.273608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: Sep 19 12:08:13.274810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05b2b8-131e-4e88-89e6-4169c7485163 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:13.330391 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 752/1497] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:08:13 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:13.334666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:13.336204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:13.370076 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c46f6-fe9e-41d4-8eaf-8ba081a77888 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:13.462994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1117f71-091c-4007-8570-fb502016a22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:13.463593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1117f71-091c-4007-8570-fb502016a22c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:13.463869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1117f71-091c-4007-8570-fb502016a22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:13.464134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1117f71-091c-4007-8570-fb502016a22c admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:13.464765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1117f71-091c-4007-8570-fb502016a22c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:13.465805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-e1117f71-091c-4007-8570-fb502016a22c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:08:13.465805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: warnings.warn(msg) Sep 19 12:08:13.465805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: Sep 19 12:08:13.466991 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1117f71-091c-4007-8570-fb502016a22c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:13.511424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 746/1498] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:08:13 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:13.515850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05b2b8-131e-4e88-89e6-4169c7485163 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:13.517338 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ac05b2b8-131e-4e88-89e6-4169c7485163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:13.578959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05b2b8-131e-4e88-89e6-4169c7485163 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:13.664616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:13.676393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186d589-f81d-4ffc-8d7e-75e10f4dd49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:13.677006 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186d589-f81d-4ffc-8d7e-75e10f4dd49b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:13.677287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186d589-f81d-4ffc-8d7e-75e10f4dd49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:13.677562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186d589-f81d-4ffc-8d7e-75e10f4dd49b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:13.678234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186d589-f81d-4ffc-8d7e-75e10f4dd49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:13.679250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-8186d589-f81d-4ffc-8d7e-75e10f4dd49b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:08:13.679250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: warnings.warn(msg) Sep 19 12:08:13.679250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: Sep 19 12:08:13.680132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186d589-f81d-4ffc-8d7e-75e10f4dd49b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:13.692612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 753/1499] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:13.696823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1117f71-091c-4007-8570-fb502016a22c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:13.698372 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e1117f71-091c-4007-8570-fb502016a22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:13.710358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1117f71-091c-4007-8570-fb502016a22c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:13.736260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:13.805309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f64a79-7ed9-4d6e-95d4-43ea07785a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:13.805947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64a79-7ed9-4d6e-95d4-43ea07785a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:13.806219 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64a79-7ed9-4d6e-95d4-43ea07785a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:13.806489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64a79-7ed9-4d6e-95d4-43ea07785a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:13.807120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f64a79-7ed9-4d6e-95d4-43ea07785a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:13.808113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-98f64a79-7ed9-4d6e-95d4-43ea07785a54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:08:13.808113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: warnings.warn(msg) Sep 19 12:08:13.808113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: Sep 19 12:08:13.809209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f64a79-7ed9-4d6e-95d4-43ea07785a54 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:13.821275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 747/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:13.825446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186d589-f81d-4ffc-8d7e-75e10f4dd49b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:13.827555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8186d589-f81d-4ffc-8d7e-75e10f4dd49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:13.861987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186d589-f81d-4ffc-8d7e-75e10f4dd49b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:13.958122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb15e26-0b61-49de-bae8-cc07ee16d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:13.958792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb15e26-0b61-49de-bae8-cc07ee16d0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:13.959084 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb15e26-0b61-49de-bae8-cc07ee16d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:13.959340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb15e26-0b61-49de-bae8-cc07ee16d0d7 admin admin] PATH_INFO: `/v3/projects/425a6a725dd24a11b93bd86234a4654d/users/1a453ad046c1436a8311ed0a5b210d04/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:13.982288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb15e26-0b61-49de-bae8-cc07ee16d0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425a6a725dd24a11b93bd86234a4654d, user_id=1a453ad046c1436a8311ed0a5b210d04, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:13.983336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-7eb15e26-0b61-49de-bae8-cc07ee16d0d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:08:13.983336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: warnings.warn(msg) Sep 19 12:08:13.983336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: Sep 19 12:08:13.985249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb15e26-0b61-49de-bae8-cc07ee16d0d7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:14.009263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 754/1501] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:13 2022] PUT /identity/v3/projects/425a6a725dd24a11b93bd86234a4654d/users/1a453ad046c1436a8311ed0a5b210d04/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:14.022190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35073a0e-abef-43ec-ac4b-c68ec3142384 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:14.022475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35073a0e-abef-43ec-ac4b-c68ec3142384 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:14.022749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35073a0e-abef-43ec-ac4b-c68ec3142384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:14.079139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-35073a0e-abef-43ec-ac4b-c68ec3142384 None None] MFA Rules not processed for user `1a453ad046c1436a8311ed0a5b210d04`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:14.080249 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-35073a0e-abef-43ec-ac4b-c68ec3142384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:14.155807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 748/1502] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:08:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:14.169023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51d107-b4cb-4bfc-bb94-375ddb6ccec1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:14.169309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51d107-b4cb-4bfc-bb94-375ddb6ccec1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:14.169584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51d107-b4cb-4bfc-bb94-375ddb6ccec1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:14.171029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 755/1503] 10.222.0.50 () {54 vars in 967 bytes} [Mon Sep 19 12:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:08:14.176046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d0415-ddf1-44e7-9472-e3e816715a8a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:14.176355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d0415-ddf1-44e7-9472-e3e816715a8a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:14.176654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d0415-ddf1-44e7-9472-e3e816715a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:14.208422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:14.253839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ea8d0415-ddf1-44e7-9472-e3e816715a8a None None] MFA Rules not processed for user `c9cdd3fefd3f44eeaf19adbfac1ea13b`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:14.255047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ea8d0415-ddf1-44e7-9472-e3e816715a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:14.331932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 749/1504] 10.222.0.50 () {58 vars in 1064 bytes} [Mon Sep 19 12:08:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:14.339697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51d107-b4cb-4bfc-bb94-375ddb6ccec1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:14.341225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ed51d107-b4cb-4bfc-bb94-375ddb6ccec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:14.391738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:14.446090 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51d107-b4cb-4bfc-bb94-375ddb6ccec1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:14.526591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f36bf-44ac-4d0a-8515-a045ca41910d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:14.527489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f36bf-44ac-4d0a-8515-a045ca41910d service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:14.527934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f36bf-44ac-4d0a-8515-a045ca41910d service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:14.528374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f36bf-44ac-4d0a-8515-a045ca41910d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:14.530143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-102f36bf-44ac-4d0a-8515-a045ca41910d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:14.634718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f36bf-44ac-4d0a-8515-a045ca41910d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:14.636063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f36bf-44ac-4d0a-8515-a045ca41910d service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:14.639844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:14.656661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 756/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:14.703526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538916c-1172-45bc-987b-aa0a6c2ec459 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:14.703949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538916c-1172-45bc-987b-aa0a6c2ec459 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:14.704070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538916c-1172-45bc-987b-aa0a6c2ec459 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:14.705335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 750/1506] 10.222.0.50 () {52 vars in 830 bytes} [Mon Sep 19 12:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:08:14.709045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f36bf-44ac-4d0a-8515-a045ca41910d service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:14.710294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-102f36bf-44ac-4d0a-8515-a045ca41910d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:14.809709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f36bf-44ac-4d0a-8515-a045ca41910d service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:14.902198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:14.902831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:14.903029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:14.903300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] PATH_INFO: `/v3/users/1a453ad046c1436a8311ed0a5b210d04` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:14.915891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a453ad046c1436a8311ed0a5b210d04)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:14.916912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:08:14.916912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: warnings.warn(msg) Sep 19 12:08:14.916912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: Sep 19 12:08:14.918138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:14.927659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:14.983819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a453ad046c1436a8311ed0a5b210d04'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:14.992529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a453ad046c1436a8311ed0a5b210d04'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:14.993006 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a453ad046c1436a8311ed0a5b210d04'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:14.993515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a453ad046c1436a8311ed0a5b210d04'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:15.007961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a453ad046c1436a8311ed0a5b210d04'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:15.036195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 757/1507] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:08:14 2022] DELETE /identity/v3/users/1a453ad046c1436a8311ed0a5b210d04 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:15.040718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816fc76-2205-43df-8eb5-0f71a18dda00 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:15.041008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816fc76-2205-43df-8eb5-0f71a18dda00 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:15.041286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816fc76-2205-43df-8eb5-0f71a18dda00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:15.097753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b816fc76-2205-43df-8eb5-0f71a18dda00 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:15.098968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b816fc76-2205-43df-8eb5-0f71a18dda00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:15.175020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:15.188656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 751/1508] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:15.197898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:15.199130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:15.298969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb50d5-ba72-45a8-b1f3-69af8959e4f6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:15.355083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:15.374940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2e13e-0847-4b1c-a03d-0637734a6dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:15.375607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2e13e-0847-4b1c-a03d-0637734a6dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:15.375881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2e13e-0847-4b1c-a03d-0637734a6dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:15.376145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2e13e-0847-4b1c-a03d-0637734a6dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:15.377766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-31b2e13e-0847-4b1c-a03d-0637734a6dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:15.487013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2e13e-0847-4b1c-a03d-0637734a6dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:15.488353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2e13e-0847-4b1c-a03d-0637734a6dc0 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:15.506748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 758/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:15.861064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816fc76-2205-43df-8eb5-0f71a18dda00 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:15.862385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b816fc76-2205-43df-8eb5-0f71a18dda00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:15.873938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816fc76-2205-43df-8eb5-0f71a18dda00 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:15.970233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:15.970860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:15.971137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:15.971406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] PATH_INFO: `/v3/projects/425a6a725dd24a11b93bd86234a4654d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:15.981381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425a6a725dd24a11b93bd86234a4654d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:15.982581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:08:15.982581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: warnings.warn(msg) Sep 19 12:08:15.982581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: Sep 19 12:08:15.983809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:16.040973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425a6a725dd24a11b93bd86234a4654d', 'request_id': 'req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:16.047031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425a6a725dd24a11b93bd86234a4654d', 'request_id': 'req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:16.056538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425a6a725dd24a11b93bd86234a4654d', 'request_id': 'req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:16.088658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] The token cache is being invalidate because project 425a6a725dd24a11b93bd86234a4654d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:08:16.088943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:16.089369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93113e3a-ac64-45a0-99cf-46c33d3ddaa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:16.090763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 752/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:08:15 2022] DELETE /identity/v3/projects/425a6a725dd24a11b93bd86234a4654d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:25.504479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=62 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:26.086676 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:52.068164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff23aa9-61ad-4b24-af32-0e37fa4650cf None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:52.068775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff23aa9-61ad-4b24-af32-0e37fa4650cf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:52.068775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff23aa9-61ad-4b24-af32-0e37fa4650cf None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:52.070070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:09:52.074922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc391-1832-4bda-96f7-6f919d9e1e8c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:52.075362 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc391-1832-4bda-96f7-6f919d9e1e8c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:52.075468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc391-1832-4bda-96f7-6f919d9e1e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:52.276397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ba9dc391-1832-4bda-96f7-6f919d9e1e8c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:09:52.279434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ba9dc391-1832-4bda-96f7-6f919d9e1e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:52.389293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:09:52.544353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff23aa9-61ad-4b24-af32-0e37fa4650cf None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:52.546420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8ff23aa9-61ad-4b24-af32-0e37fa4650cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:52.665787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff23aa9-61ad-4b24-af32-0e37fa4650cf None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:52.673820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcc401-d720-4ad2-aa87-b2cd425aecc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:52.674590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc401-d720-4ad2-aa87-b2cd425aecc5 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:52.674873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc401-d720-4ad2-aa87-b2cd425aecc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:52.675211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc401-d720-4ad2-aa87-b2cd425aecc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:52.683700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcc401-d720-4ad2-aa87-b2cd425aecc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:52.685425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcc401-d720-4ad2-aa87-b2cd425aecc5 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:52.696073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 760/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:09:53.578393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c971823-651a-46f4-9d68-263a628be687 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:53.578924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c971823-651a-46f4-9d68-263a628be687 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:53.579519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c971823-651a-46f4-9d68-263a628be687 None None] PATH_INFO: `/v3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:53.580988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 754/1514] 10.222.0.86 () {54 vars in 925 bytes} [Mon Sep 19 12:09:53 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:09:53.587298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e025f-8bca-4928-9a0d-9be736c7c0d7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:53.587762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e025f-8bca-4928-9a0d-9be736c7c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:53.587873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e025f-8bca-4928-9a0d-9be736c7c0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:53.652037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-db3e025f-8bca-4928-9a0d-9be736c7c0d7 None None] MFA Rules not processed for user `1aded088aa2a40e4b7fe024647ebfbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:09:53.653225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-db3e025f-8bca-4928-9a0d-9be736c7c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:53.723498 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:53.729548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 761/1515] 10.222.0.86 () {58 vars in 1015 bytes} [Mon Sep 19 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:09:53.783848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43acf55-a5c4-4587-a473-4f93380f9b1f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:53.784133 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43acf55-a5c4-4587-a473-4f93380f9b1f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:53.784409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43acf55-a5c4-4587-a473-4f93380f9b1f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:53.785800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 755/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:09:53.791807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0574e-3b84-4168-bbfb-bd222bf51f3b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:53.792103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0574e-3b84-4168-bbfb-bd222bf51f3b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:53.792388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0574e-3b84-4168-bbfb-bd222bf51f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:53.811755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-48d0574e-3b84-4168-bbfb-bd222bf51f3b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:09:53.812957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-48d0574e-3b84-4168-bbfb-bd222bf51f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:53.821593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 762/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:09:53.974750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43acf55-a5c4-4587-a473-4f93380f9b1f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:53.989919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43acf55-a5c4-4587-a473-4f93380f9b1f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:53.995144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d280a0c-0d51-4aa9-b5d5-8b834f1f5235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:53.995726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280a0c-0d51-4aa9-b5d5-8b834f1f5235 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:53.996001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280a0c-0d51-4aa9-b5d5-8b834f1f5235 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:53.996271 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280a0c-0d51-4aa9-b5d5-8b834f1f5235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:54.004130 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d280a0c-0d51-4aa9-b5d5-8b834f1f5235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:54.005715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d280a0c-0d51-4aa9-b5d5-8b834f1f5235 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:54.014824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 756/1518] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:10:02.458616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d09af3-e36c-4c9c-af25-c96813c23fc1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:02.459105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d09af3-e36c-4c9c-af25-c96813c23fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:02.459212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d09af3-e36c-4c9c-af25-c96813c23fc1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:02.460464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 763/1519] 10.222.0.50 () {54 vars in 961 bytes} [Mon Sep 19 12:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:10:02.465417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949cfb3-46de-4b46-b80a-fb2eb1487230 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:02.465865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949cfb3-46de-4b46-b80a-fb2eb1487230 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:02.465972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949cfb3-46de-4b46-b80a-fb2eb1487230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:02.486353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8949cfb3-46de-4b46-b80a-fb2eb1487230 None None] MFA Rules not processed for user `1aded088aa2a40e4b7fe024647ebfbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:10:02.487590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8949cfb3-46de-4b46-b80a-fb2eb1487230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:02.495956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 757/1520] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Sep 19 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:10:02.503959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d09af3-e36c-4c9c-af25-c96813c23fc1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:10:02.517382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d09af3-e36c-4c9c-af25-c96813c23fc1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:10:02.522323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc60ba4-01bf-4038-9ec8-331825bb58c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:10:02.522909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc60ba4-01bf-4038-9ec8-331825bb58c8 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:02.523186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc60ba4-01bf-4038-9ec8-331825bb58c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:02.523454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc60ba4-01bf-4038-9ec8-331825bb58c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:02.531399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc60ba4-01bf-4038-9ec8-331825bb58c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:10:02.533152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc60ba4-01bf-4038-9ec8-331825bb58c8 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:10:02.542456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 764/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:10:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:10:05.506890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be98c9-c55a-4351-99e1-f58f39f3a0d7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:05.507502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be98c9-c55a-4351-99e1-f58f39f3a0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:05.507502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be98c9-c55a-4351-99e1-f58f39f3a0d7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:05.508761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:10:05.514783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a271e0-0399-4f75-b545-a7a307615750 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:05.515196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a271e0-0399-4f75-b545-a7a307615750 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:05.515348 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a271e0-0399-4f75-b545-a7a307615750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:05.535346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b2a271e0-0399-4f75-b545-a7a307615750 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:10:05.536526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b2a271e0-0399-4f75-b545-a7a307615750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:05.544178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:10:05.701296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be98c9-c55a-4351-99e1-f58f39f3a0d7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:10:05.716272 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be98c9-c55a-4351-99e1-f58f39f3a0d7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:10:05.721823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f62e3-66d1-496a-b014-14d8ef6861a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:10:05.722408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f62e3-66d1-496a-b014-14d8ef6861a9 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:05.722683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f62e3-66d1-496a-b014-14d8ef6861a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:05.722952 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f62e3-66d1-496a-b014-14d8ef6861a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:05.731128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f62e3-66d1-496a-b014-14d8ef6861a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:10:05.732683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f62e3-66d1-496a-b014-14d8ef6861a9 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:10:05.741904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 759/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:10:06.820306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c8874-6687-4650-8d3d-63983c568330 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:06.820868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c8874-6687-4650-8d3d-63983c568330 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:06.820868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c8874-6687-4650-8d3d-63983c568330 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:06.822263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 12:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:10:06.828451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076e979-8ffe-447a-9d62-4a6e5e7d5b3a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:06.829373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076e979-8ffe-447a-9d62-4a6e5e7d5b3a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:06.829509 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076e979-8ffe-447a-9d62-4a6e5e7d5b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:06.849446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3076e979-8ffe-447a-9d62-4a6e5e7d5b3a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:10:06.850659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3076e979-8ffe-447a-9d62-4a6e5e7d5b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:06.858634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:10:07.010986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c8874-6687-4650-8d3d-63983c568330 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:10:07.026074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c8874-6687-4650-8d3d-63983c568330 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:10:07.031375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2556-06b3-4b1a-b8a6-6a3928e78ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:10:07.032606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2556-06b3-4b1a-b8a6-6a3928e78ed4 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:07.032882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2556-06b3-4b1a-b8a6-6a3928e78ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:07.033150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2556-06b3-4b1a-b8a6-6a3928e78ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:07.041162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2556-06b3-4b1a-b8a6-6a3928e78ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:10:07.042759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2556-06b3-4b1a-b8a6-6a3928e78ed4 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:10:07.051920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 767/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:10:11.094183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2751f6-acc4-46a6-84ab-3c20b61000c8 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:11.096556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2751f6-acc4-46a6-84ab-3c20b61000c8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:11.096556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2751f6-acc4-46a6-84ab-3c20b61000c8 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:11.096768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:10:11.102078 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43fc9e-186d-4a2d-9691-1c1212b04805 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:11.102545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43fc9e-186d-4a2d-9691-1c1212b04805 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:11.102650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43fc9e-186d-4a2d-9691-1c1212b04805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:11.122202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2c43fc9e-186d-4a2d-9691-1c1212b04805 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:10:11.123380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2c43fc9e-186d-4a2d-9691-1c1212b04805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:11.131247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:10:11.423688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2751f6-acc4-46a6-84ab-3c20b61000c8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:10:11.425360 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8e2751f6-acc4-46a6-84ab-3c20b61000c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:11.457893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:11.503755 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2751f6-acc4-46a6-84ab-3c20b61000c8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:10:11.507347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666ada-5a1f-41cb-8057-b50a931deed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:10:11.507950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666ada-5a1f-41cb-8057-b50a931deed7 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:11.508229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666ada-5a1f-41cb-8057-b50a931deed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:11.508498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666ada-5a1f-41cb-8057-b50a931deed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:11.517685 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c666ada-5a1f-41cb-8057-b50a931deed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:10:11.519103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c666ada-5a1f-41cb-8057-b50a931deed7 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:10:11.528284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 762/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:10:13.678557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb042ee-e01d-453d-a2d0-aa0f863ec5f8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:13.679052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb042ee-e01d-453d-a2d0-aa0f863ec5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:13.679197 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb042ee-e01d-453d-a2d0-aa0f863ec5f8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:13.680670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:10:13.686092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981894d-cc94-403b-a591-a30a05cca8eb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:13.686551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981894d-cc94-403b-a591-a30a05cca8eb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:13.686671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981894d-cc94-403b-a591-a30a05cca8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:13.706656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5981894d-cc94-403b-a591-a30a05cca8eb None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:10:13.707846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5981894d-cc94-403b-a591-a30a05cca8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:13.715568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:10:14.011964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb042ee-e01d-453d-a2d0-aa0f863ec5f8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:10:14.013698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fbb042ee-e01d-453d-a2d0-aa0f863ec5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:14.027049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb042ee-e01d-453d-a2d0-aa0f863ec5f8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:10:14.030592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86829c-dcf1-45db-9ccd-6d69a85e09a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:10:14.031187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86829c-dcf1-45db-9ccd-6d69a85e09a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:14.031465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86829c-dcf1-45db-9ccd-6d69a85e09a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:14.031767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86829c-dcf1-45db-9ccd-6d69a85e09a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:14.040497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86829c-dcf1-45db-9ccd-6d69a85e09a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:10:14.041950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86829c-dcf1-45db-9ccd-6d69a85e09a6 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:10:14.051226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 770/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:10:17.839955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815738-1d96-4f75-b23e-37d0560bb32f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:17.840499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815738-1d96-4f75-b23e-37d0560bb32f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:17.840499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815738-1d96-4f75-b23e-37d0560bb32f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:17.841788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:10:17.847525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42694-1d35-45ce-8782-e77bac9a4432 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:17.847967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42694-1d35-45ce-8782-e77bac9a4432 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:17.848073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42694-1d35-45ce-8782-e77bac9a4432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:17.868712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0cc42694-1d35-45ce-8782-e77bac9a4432 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:10:17.869922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0cc42694-1d35-45ce-8782-e77bac9a4432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:17.877671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:10:18.181210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815738-1d96-4f75-b23e-37d0560bb32f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:10:18.182975 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5b815738-1d96-4f75-b23e-37d0560bb32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:18.261445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815738-1d96-4f75-b23e-37d0560bb32f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:10:18.265048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963d881-7bc8-4662-b993-a48268f95031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:10:18.265663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963d881-7bc8-4662-b993-a48268f95031 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:18.266453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963d881-7bc8-4662-b993-a48268f95031 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:18.266930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963d881-7bc8-4662-b993-a48268f95031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:18.275787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963d881-7bc8-4662-b993-a48268f95031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:10:18.277205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963d881-7bc8-4662-b993-a48268f95031 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:10:18.287139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 765/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:10:20.425204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e33cdb-7dce-4409-9b52-2b9bb07c5c10 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:20.425821 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e33cdb-7dce-4409-9b52-2b9bb07c5c10 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:20.425821 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e33cdb-7dce-4409-9b52-2b9bb07c5c10 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:20.427098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 12:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:10:20.432239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd10f-ccdc-4967-a3a4-6d3850e2c098 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:20.432695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd10f-ccdc-4967-a3a4-6d3850e2c098 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:20.432816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd10f-ccdc-4967-a3a4-6d3850e2c098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:20.453098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6d8cd10f-ccdc-4967-a3a4-6d3850e2c098 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:10:20.454382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6d8cd10f-ccdc-4967-a3a4-6d3850e2c098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:20.462117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:10:20.762920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e33cdb-7dce-4409-9b52-2b9bb07c5c10 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:10:20.764594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e5e33cdb-7dce-4409-9b52-2b9bb07c5c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:10:20.777282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e33cdb-7dce-4409-9b52-2b9bb07c5c10 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:10:20.780690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c841f7-bfc4-4a2e-ab79-a0872dd0e8ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:10:20.781273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c841f7-bfc4-4a2e-ab79-a0872dd0e8ec service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:20.782188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c841f7-bfc4-4a2e-ab79-a0872dd0e8ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:20.782478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c841f7-bfc4-4a2e-ab79-a0872dd0e8ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:20.791274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c841f7-bfc4-4a2e-ab79-a0872dd0e8ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:10:20.792698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c841f7-bfc4-4a2e-ab79-a0872dd0e8ec service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:10:20.802992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 773/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:10:30.447028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=63 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:30.798873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=37 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:56.137045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4b62-516f-441e-9b6f-2d40809cecd6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.138163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4b62-516f-441e-9b6f-2d40809cecd6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.138163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4b62-516f-441e-9b6f-2d40809cecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.162791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-be6a4b62-516f-441e-9b6f-2d40809cecd6 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.164007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-be6a4b62-516f-441e-9b6f-2d40809cecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.180354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 767/1540] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.188919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9dc1-21dc-411e-be12-f42eb284c87b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.189683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9dc1-21dc-411e-be12-f42eb284c87b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.189683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9dc1-21dc-411e-be12-f42eb284c87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.193502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af38bbd-e8e9-4893-88fe-04c18649ab65 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.193825 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af38bbd-e8e9-4893-88fe-04c18649ab65 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.194103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af38bbd-e8e9-4893-88fe-04c18649ab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.218476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9f7f9dc1-21dc-411e-be12-f42eb284c87b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.220511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9f7f9dc1-21dc-411e-be12-f42eb284c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.226115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2af38bbd-e8e9-4893-88fe-04c18649ab65 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.227357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2af38bbd-e8e9-4893-88fe-04c18649ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.236149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 774/1541] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.243432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9dc1-21dc-411e-be12-f42eb284c87b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.247200 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 768/1542] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.256506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaaa0a-5497-43a2-a258-5b75a566d073 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.256847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaaa0a-5497-43a2-a258-5b75a566d073 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.257051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaaa0a-5497-43a2-a258-5b75a566d073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.260511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9dc1-21dc-411e-be12-f42eb284c87b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.265464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63311e-e13b-4136-9827-b37d388deb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.266125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63311e-e13b-4136-9827-b37d388deb4d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.267271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63311e-e13b-4136-9827-b37d388deb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.267601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63311e-e13b-4136-9827-b37d388deb4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.268200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63311e-e13b-4136-9827-b37d388deb4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:11:56.268797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63311e-e13b-4136-9827-b37d388deb4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.273999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-2d63311e-e13b-4136-9827-b37d388deb4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:11:56.273999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: warnings.warn(msg) Sep 19 12:11:56.273999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: Sep 19 12:11:56.274999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63311e-e13b-4136-9827-b37d388deb4d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.291089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2faaaa0a-5497-43a2-a258-5b75a566d073 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.292358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2faaaa0a-5497-43a2-a258-5b75a566d073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.294460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 775/1543] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:11:56.304577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63311e-e13b-4136-9827-b37d388deb4d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.311735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 769/1544] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:11:56.316438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaaa0a-5497-43a2-a258-5b75a566d073 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.320569 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63311e-e13b-4136-9827-b37d388deb4d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.330782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4920180-1834-4cb0-bfc4-719914b2337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.331403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4920180-1834-4cb0-bfc4-719914b2337c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.331680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4920180-1834-4cb0-bfc4-719914b2337c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.331951 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4920180-1834-4cb0-bfc4-719914b2337c admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.332069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaaa0a-5497-43a2-a258-5b75a566d073 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.332674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4920180-1834-4cb0-bfc4-719914b2337c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.334616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4920180-1834-4cb0-bfc4-719914b2337c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.349818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fa75f-e2a5-44b1-9bf6-78cea7b200be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.350441 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fa75f-e2a5-44b1-9bf6-78cea7b200be admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.350721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fa75f-e2a5-44b1-9bf6-78cea7b200be admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.350994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fa75f-e2a5-44b1-9bf6-78cea7b200be admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.351647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fa75f-e2a5-44b1-9bf6-78cea7b200be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:11:56.351948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fa75f-e2a5-44b1-9bf6-78cea7b200be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.353551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fa75f-e2a5-44b1-9bf6-78cea7b200be admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.387982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 770/1545] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:11:56.388964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbe22c-7ec2-4249-af08-27b79e026296 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.390783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbe22c-7ec2-4249-af08-27b79e026296 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.391071 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbe22c-7ec2-4249-af08-27b79e026296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.417939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-86fbe22c-7ec2-4249-af08-27b79e026296 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.419145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-86fbe22c-7ec2-4249-af08-27b79e026296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.425865 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 776/1546] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:56.427179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d8e3b-13f9-451f-a219-7a0641459bbf None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.427491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d8e3b-13f9-451f-a219-7a0641459bbf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.427745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d8e3b-13f9-451f-a219-7a0641459bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.436922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 771/1547] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.437763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbe22c-7ec2-4249-af08-27b79e026296 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.459052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbe22c-7ec2-4249-af08-27b79e026296 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.468613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fe0d8e3b-13f9-451f-a219-7a0641459bbf None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.470789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fe0d8e3b-13f9-451f-a219-7a0641459bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.530899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463932a-393e-419a-a180-e1d3b78226c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.531518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463932a-393e-419a-a180-e1d3b78226c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.531800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463932a-393e-419a-a180-e1d3b78226c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.532112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463932a-393e-419a-a180-e1d3b78226c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.533137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463932a-393e-419a-a180-e1d3b78226c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.534194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-0463932a-393e-419a-a180-e1d3b78226c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:11:56.534194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: warnings.warn(msg) Sep 19 12:11:56.534194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: Sep 19 12:11:56.535385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463932a-393e-419a-a180-e1d3b78226c1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.552056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 777/1548] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.553763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853333-995a-415f-8d55-ee1819ff5938 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.554202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853333-995a-415f-8d55-ee1819ff5938 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.554691 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853333-995a-415f-8d55-ee1819ff5938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.566237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 772/1549] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:56.567191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463932a-393e-419a-a180-e1d3b78226c1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.576771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b8853333-995a-415f-8d55-ee1819ff5938 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.577986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b8853333-995a-415f-8d55-ee1819ff5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.630007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463932a-393e-419a-a180-e1d3b78226c1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.634919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4ba24-1248-4c75-822d-154317a1ffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.635561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4ba24-1248-4c75-822d-154317a1ffd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.635845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4ba24-1248-4c75-822d-154317a1ffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.636119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4ba24-1248-4c75-822d-154317a1ffd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.636748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4ba24-1248-4c75-822d-154317a1ffd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.637787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 778/1550] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.638769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4ba24-1248-4c75-822d-154317a1ffd2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.639104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e1e2a-db01-4d20-98a9-0e67324c97c8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.639389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e1e2a-db01-4d20-98a9-0e67324c97c8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.639662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e1e2a-db01-4d20-98a9-0e67324c97c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.660769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b62e1e2a-db01-4d20-98a9-0e67324c97c8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.661982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b62e1e2a-db01-4d20-98a9-0e67324c97c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.667074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 773/1551] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:56.668559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d043-7969-4851-88f3-30ebda1e12bf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.668847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d043-7969-4851-88f3-30ebda1e12bf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.669117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d043-7969-4851-88f3-30ebda1e12bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.674043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 779/1552] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.675012 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9f160-07a1-429b-be83-1448ffbe5d37 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.675318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9f160-07a1-429b-be83-1448ffbe5d37 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.675591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9f160-07a1-429b-be83-1448ffbe5d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.692498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8a06d043-7969-4851-88f3-30ebda1e12bf None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.693796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8a06d043-7969-4851-88f3-30ebda1e12bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.696787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c7b9f160-07a1-429b-be83-1448ffbe5d37 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.697979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c7b9f160-07a1-429b-be83-1448ffbe5d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.702044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 774/1553] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.703332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957462d-ecc8-4ef9-b0bb-77fef0efa06a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.703614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957462d-ecc8-4ef9-b0bb-77fef0efa06a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.704038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957462d-ecc8-4ef9-b0bb-77fef0efa06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.711892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 780/1554] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.713135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66956f9c-4591-40b5-913c-a49ec4a6092c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.713423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66956f9c-4591-40b5-913c-a49ec4a6092c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.713728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66956f9c-4591-40b5-913c-a49ec4a6092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.728973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3957462d-ecc8-4ef9-b0bb-77fef0efa06a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.730549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3957462d-ecc8-4ef9-b0bb-77fef0efa06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.737734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-66956f9c-4591-40b5-913c-a49ec4a6092c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.739008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-66956f9c-4591-40b5-913c-a49ec4a6092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.739138 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 775/1555] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.739771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957462d-ecc8-4ef9-b0bb-77fef0efa06a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.749323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957462d-ecc8-4ef9-b0bb-77fef0efa06a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.753068 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 781/1556] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.756019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee6aa-f692-4647-9367-aaefb93f965b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.756019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee6aa-f692-4647-9367-aaefb93f965b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.756019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee6aa-f692-4647-9367-aaefb93f965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.757029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47691630-76e1-4e44-bded-634b2b9ba8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.757649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691630-76e1-4e44-bded-634b2b9ba8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.757927 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691630-76e1-4e44-bded-634b2b9ba8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.758195 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691630-76e1-4e44-bded-634b2b9ba8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.758816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47691630-76e1-4e44-bded-634b2b9ba8a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.760711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47691630-76e1-4e44-bded-634b2b9ba8a4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.783248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-856ee6aa-f692-4647-9367-aaefb93f965b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.783810 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 776/1557] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:56.784869 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-856ee6aa-f692-4647-9367-aaefb93f965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.786547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47691630-76e1-4e44-bded-634b2b9ba8a4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.792982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:56.793376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 782/1558] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.794222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ee6aa-f692-4647-9367-aaefb93f965b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.798272 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47691630-76e1-4e44-bded-634b2b9ba8a4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.803903 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0255b69-ad1a-42f2-910b-b4e3d727c22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.804505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255b69-ad1a-42f2-910b-b4e3d727c22e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.804999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255b69-ad1a-42f2-910b-b4e3d727c22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.805127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ee6aa-f692-4647-9367-aaefb93f965b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.805568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255b69-ad1a-42f2-910b-b4e3d727c22e admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.806243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0255b69-ad1a-42f2-910b-b4e3d727c22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.807874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0255b69-ad1a-42f2-910b-b4e3d727c22e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.810035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886aac-80db-4f44-acf5-3dff5e10c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.810634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886aac-80db-4f44-acf5-3dff5e10c1ad admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.810917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886aac-80db-4f44-acf5-3dff5e10c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.811193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886aac-80db-4f44-acf5-3dff5e10c1ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.811862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886aac-80db-4f44-acf5-3dff5e10c1ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:11:56.812171 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886aac-80db-4f44-acf5-3dff5e10c1ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.813842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886aac-80db-4f44-acf5-3dff5e10c1ad admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.821816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 777/1559] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:56.821816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76af2d3-3d35-4977-a7cb-50050000ed1d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.821816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76af2d3-3d35-4977-a7cb-50050000ed1d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.821816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76af2d3-3d35-4977-a7cb-50050000ed1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.832771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 783/1560] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:11:56.832771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23431403-8a7f-445d-8f5f-fa6dd567cb02 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.832771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23431403-8a7f-445d-8f5f-fa6dd567cb02 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.832771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23431403-8a7f-445d-8f5f-fa6dd567cb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.846894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a76af2d3-3d35-4977-a7cb-50050000ed1d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.847377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-23431403-8a7f-445d-8f5f-fa6dd567cb02 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.848106 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a76af2d3-3d35-4977-a7cb-50050000ed1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.848531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-23431403-8a7f-445d-8f5f-fa6dd567cb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.856184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 778/1561] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.856953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 784/1562] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.857561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2994a-82cd-42ee-bb71-8776b6469bee None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.857889 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2994a-82cd-42ee-bb71-8776b6469bee None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.858165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2994a-82cd-42ee-bb71-8776b6469bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.862091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23431403-8a7f-445d-8f5f-fa6dd567cb02 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.867930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:56.872118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23431403-8a7f-445d-8f5f-fa6dd567cb02 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.877892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42394020-b07b-4594-8d2b-20f3c6abd21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.878408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1ba2994a-82cd-42ee-bb71-8776b6469bee None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:56.878523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42394020-b07b-4594-8d2b-20f3c6abd21d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.878783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42394020-b07b-4594-8d2b-20f3c6abd21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.879054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42394020-b07b-4594-8d2b-20f3c6abd21d admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.879596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1ba2994a-82cd-42ee-bb71-8776b6469bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:56.879691 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42394020-b07b-4594-8d2b-20f3c6abd21d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:11:56.879972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42394020-b07b-4594-8d2b-20f3c6abd21d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.881552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42394020-b07b-4594-8d2b-20f3c6abd21d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.887300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 779/1563] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:56.888154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2994a-82cd-42ee-bb71-8776b6469bee None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.904107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 785/1564] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:11:56.904107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42394020-b07b-4594-8d2b-20f3c6abd21d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.904389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2994a-82cd-42ee-bb71-8776b6469bee None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.904389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9c3c7-80a3-4e52-a4e0-a4e54d5c6972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.904389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9c3c7-80a3-4e52-a4e0-a4e54d5c6972 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.904389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9c3c7-80a3-4e52-a4e0-a4e54d5c6972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.904779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9c3c7-80a3-4e52-a4e0-a4e54d5c6972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.904779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9c3c7-80a3-4e52-a4e0-a4e54d5c6972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.905949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9c3c7-80a3-4e52-a4e0-a4e54d5c6972 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.910638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42394020-b07b-4594-8d2b-20f3c6abd21d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.915190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2526-6f83-442e-9b05-eca53c923e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.915770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2526-6f83-442e-9b05-eca53c923e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.916049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2526-6f83-442e-9b05-eca53c923e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.916319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2526-6f83-442e-9b05-eca53c923e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.916419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 780/1565] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:56.916942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2526-6f83-442e-9b05-eca53c923e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:11:56.917243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2526-6f83-442e-9b05-eca53c923e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.917346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9c3c7-80a3-4e52-a4e0-a4e54d5c6972 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.918834 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2526-6f83-442e-9b05-eca53c923e80 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.927308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9c3c7-80a3-4e52-a4e0-a4e54d5c6972 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.932374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529761d-1b43-424b-984a-bbd0d73cb95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.933652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 786/1566] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:11:56.933803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529761d-1b43-424b-984a-bbd0d73cb95a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.933803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529761d-1b43-424b-984a-bbd0d73cb95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.933961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2526-6f83-442e-9b05-eca53c923e80 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.934039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529761d-1b43-424b-984a-bbd0d73cb95a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.934287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529761d-1b43-424b-984a-bbd0d73cb95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.935805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529761d-1b43-424b-984a-bbd0d73cb95a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.943437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2526-6f83-442e-9b05-eca53c923e80 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.949322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 781/1567] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:56.949322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529761d-1b43-424b-984a-bbd0d73cb95a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.949553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aedd07-eb93-4ee9-a2c8-2abefd201cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.949553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aedd07-eb93-4ee9-a2c8-2abefd201cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.949553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aedd07-eb93-4ee9-a2c8-2abefd201cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.949553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aedd07-eb93-4ee9-a2c8-2abefd201cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.949901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aedd07-eb93-4ee9-a2c8-2abefd201cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.951631 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aedd07-eb93-4ee9-a2c8-2abefd201cf4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.957187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529761d-1b43-424b-984a-bbd0d73cb95a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:56.961636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b03eb-3f23-4866-afe8-3ac965b8c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:56.962212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b03eb-3f23-4866-afe8-3ac965b8c545 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:56.962492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b03eb-3f23-4866-afe8-3ac965b8c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:56.962791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b03eb-3f23-4866-afe8-3ac965b8c545 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:56.963515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b03eb-3f23-4866-afe8-3ac965b8c545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:11:56.963815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b03eb-3f23-4866-afe8-3ac965b8c545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:56.965377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b03eb-3f23-4866-afe8-3ac965b8c545 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:56.979126 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 782/1568] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:11:56.980055 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 787/1569] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:56.980181 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b03eb-3f23-4866-afe8-3ac965b8c545 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.980653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aedd07-eb93-4ee9-a2c8-2abefd201cf4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:56.996575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b03eb-3f23-4866-afe8-3ac965b8c545 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.047304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aedd07-eb93-4ee9-a2c8-2abefd201cf4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.051454 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1873e-68ed-4f9c-b78c-7ffcfe14fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.052090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1873e-68ed-4f9c-b78c-7ffcfe14fd6b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.052364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1873e-68ed-4f9c-b78c-7ffcfe14fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.052646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1873e-68ed-4f9c-b78c-7ffcfe14fd6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.053268 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1873e-68ed-4f9c-b78c-7ffcfe14fd6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:11:57.053564 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1873e-68ed-4f9c-b78c-7ffcfe14fd6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.054887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c8a66-d914-4e11-b93d-3041b960ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.055169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1873e-68ed-4f9c-b78c-7ffcfe14fd6b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.055900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8a66-d914-4e11-b93d-3041b960ee00 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.056089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8a66-d914-4e11-b93d-3041b960ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.056366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8a66-d914-4e11-b93d-3041b960ee00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.057028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c8a66-d914-4e11-b93d-3041b960ee00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:11:57.057338 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c8a66-d914-4e11-b93d-3041b960ee00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.058995 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c8a66-d914-4e11-b93d-3041b960ee00 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.069632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 783/1570] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:11:57.070473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1873e-68ed-4f9c-b78c-7ffcfe14fd6b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.077588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 788/1571] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:11:57.080808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1873e-68ed-4f9c-b78c-7ffcfe14fd6b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.081463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c8a66-d914-4e11-b93d-3041b960ee00 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.085456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d585178-2fac-4779-90d0-b1b66fe8223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.086075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585178-2fac-4779-90d0-b1b66fe8223b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.086356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585178-2fac-4779-90d0-b1b66fe8223b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.086631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585178-2fac-4779-90d0-b1b66fe8223b admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.087288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d585178-2fac-4779-90d0-b1b66fe8223b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.089168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d585178-2fac-4779-90d0-b1b66fe8223b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.094061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c8a66-d914-4e11-b93d-3041b960ee00 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.098913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafcdf6-986e-4bfc-8043-e1abd5524471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.099507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafcdf6-986e-4bfc-8043-e1abd5524471 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.099786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafcdf6-986e-4bfc-8043-e1abd5524471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.100058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafcdf6-986e-4bfc-8043-e1abd5524471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.100691 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafcdf6-986e-4bfc-8043-e1abd5524471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.102296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafcdf6-986e-4bfc-8043-e1abd5524471 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.114177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 789/1572] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:57.115646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafcdf6-986e-4bfc-8043-e1abd5524471 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.120591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 784/1573] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.120591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d585178-2fac-4779-90d0-b1b66fe8223b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.126371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafcdf6-986e-4bfc-8043-e1abd5524471 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.181575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d585178-2fac-4779-90d0-b1b66fe8223b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.184124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0936ca-a8e5-49ca-ab91-3f3d7fae7060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.184739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0936ca-a8e5-49ca-ab91-3f3d7fae7060 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.185019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0936ca-a8e5-49ca-ab91-3f3d7fae7060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.185297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0936ca-a8e5-49ca-ab91-3f3d7fae7060 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.185948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0936ca-a8e5-49ca-ab91-3f3d7fae7060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.186616 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84bf9e-afea-40aa-aaee-b7c5063f9823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.187275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84bf9e-afea-40aa-aaee-b7c5063f9823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.187555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84bf9e-afea-40aa-aaee-b7c5063f9823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.187829 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84bf9e-afea-40aa-aaee-b7c5063f9823 admin admin] PATH_INFO: `/v3/projects/481ae03223e14b4b9311e03e2d15e9b8/users/4877c2635b764dd2a46e9898e4954fa7/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.187930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0936ca-a8e5-49ca-ab91-3f3d7fae7060 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.202426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84bf9e-afea-40aa-aaee-b7c5063f9823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481ae03223e14b4b9311e03e2d15e9b8, user_id=4877c2635b764dd2a46e9898e4954fa7, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.203467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-3b84bf9e-afea-40aa-aaee-b7c5063f9823 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:11:57.203467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: warnings.warn(msg) Sep 19 12:11:57.203467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: Sep 19 12:11:57.206516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84bf9e-afea-40aa-aaee-b7c5063f9823 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.215959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:57.216545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 790/1574] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.217339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0936ca-a8e5-49ca-ab91-3f3d7fae7060 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.222836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 785/1575] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:57 2022] PUT /identity/v3/projects/481ae03223e14b4b9311e03e2d15e9b8/users/4877c2635b764dd2a46e9898e4954fa7/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:57.224498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84bf9e-afea-40aa-aaee-b7c5063f9823 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.247224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:57.284062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0936ca-a8e5-49ca-ab91-3f3d7fae7060 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.289183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84bf9e-afea-40aa-aaee-b7c5063f9823 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.289751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ece2a-b069-42ca-93a6-1916ecb860e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.290355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ece2a-b069-42ca-93a6-1916ecb860e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.290629 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ece2a-b069-42ca-93a6-1916ecb860e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.290901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ece2a-b069-42ca-93a6-1916ecb860e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.291612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ece2a-b069-42ca-93a6-1916ecb860e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.293495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ece2a-b069-42ca-93a6-1916ecb860e0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.294021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8b328-f31a-4db5-b64d-8e2c553821ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.294623 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b328-f31a-4db5-b64d-8e2c553821ee admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.294903 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b328-f31a-4db5-b64d-8e2c553821ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.295177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b328-f31a-4db5-b64d-8e2c553821ee admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.295799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8b328-f31a-4db5-b64d-8e2c553821ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.298256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8b328-f31a-4db5-b64d-8e2c553821ee admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.320618 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 786/1576] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.321329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8b328-f31a-4db5-b64d-8e2c553821ee admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.324978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 791/1577] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.324978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ece2a-b069-42ca-93a6-1916ecb860e0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.334451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8b328-f31a-4db5-b64d-8e2c553821ee admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.384180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ece2a-b069-42ca-93a6-1916ecb860e0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.388969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d564-76f3-4174-8d9c-9bd5bebd8ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.389813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d564-76f3-4174-8d9c-9bd5bebd8ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.389958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cebae2-10bc-495e-8c54-e90e59d2ae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.390300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d564-76f3-4174-8d9c-9bd5bebd8ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.390567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cebae2-10bc-495e-8c54-e90e59d2ae51 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.390751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d564-76f3-4174-8d9c-9bd5bebd8ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.390857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cebae2-10bc-495e-8c54-e90e59d2ae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.391097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cebae2-10bc-495e-8c54-e90e59d2ae51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.391649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8d564-76f3-4174-8d9c-9bd5bebd8ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.391762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cebae2-10bc-495e-8c54-e90e59d2ae51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.393627 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cebae2-10bc-495e-8c54-e90e59d2ae51 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.393760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8d564-76f3-4174-8d9c-9bd5bebd8ff1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.420730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 792/1578] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.421827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 787/1579] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.422718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d564-76f3-4174-8d9c-9bd5bebd8ff1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.425818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cebae2-10bc-495e-8c54-e90e59d2ae51 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.486427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d564-76f3-4174-8d9c-9bd5bebd8ff1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.488099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cebae2-10bc-495e-8c54-e90e59d2ae51 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.491184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259ff4f-7d03-4c2f-ad55-e4743084ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.491874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259ff4f-7d03-4c2f-ad55-e4743084ff55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.492182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259ff4f-7d03-4c2f-ad55-e4743084ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.492573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259ff4f-7d03-4c2f-ad55-e4743084ff55 admin admin] PATH_INFO: `/v3/projects/07ae5faab0ea45f2853b3569642e90c2/users/2bb68c40e4964cb0b3d74fdf9d91cb2c/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.492688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32f43d-9c16-4157-b2b1-4159dfe336cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.493231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32f43d-9c16-4157-b2b1-4159dfe336cf admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.493614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32f43d-9c16-4157-b2b1-4159dfe336cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.493911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32f43d-9c16-4157-b2b1-4159dfe336cf admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.494544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32f43d-9c16-4157-b2b1-4159dfe336cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.496496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32f43d-9c16-4157-b2b1-4159dfe336cf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.507556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259ff4f-7d03-4c2f-ad55-e4743084ff55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ae5faab0ea45f2853b3569642e90c2, user_id=2bb68c40e4964cb0b3d74fdf9d91cb2c, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.510548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259ff4f-7d03-4c2f-ad55-e4743084ff55 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.519792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 788/1580] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.520582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32f43d-9c16-4157-b2b1-4159dfe336cf admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.526048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 793/1581] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:57 2022] PUT /identity/v3/projects/07ae5faab0ea45f2853b3569642e90c2/users/2bb68c40e4964cb0b3d74fdf9d91cb2c/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:57.526463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:57.527504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa03c28-b050-4a54-b2bb-92d70fafdc61 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.529932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa03c28-b050-4a54-b2bb-92d70fafdc61 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.529932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa03c28-b050-4a54-b2bb-92d70fafdc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.531703 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32f43d-9c16-4157-b2b1-4159dfe336cf admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.557866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dfa03c28-b050-4a54-b2bb-92d70fafdc61 None None] MFA Rules not processed for user `4877c2635b764dd2a46e9898e4954fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:57.559112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dfa03c28-b050-4a54-b2bb-92d70fafdc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:57.565015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:57.592103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87686243-590b-46d9-8253-bc4bc801c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.592711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87686243-590b-46d9-8253-bc4bc801c16f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.592990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87686243-590b-46d9-8253-bc4bc801c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.593261 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87686243-590b-46d9-8253-bc4bc801c16f admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.593922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87686243-590b-46d9-8253-bc4bc801c16f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.595850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87686243-590b-46d9-8253-bc4bc801c16f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.618602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 789/1582] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.619574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87686243-590b-46d9-8253-bc4bc801c16f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.627329 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 794/1583] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:57.627329 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa03c28-b050-4a54-b2bb-92d70fafdc61 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.631201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87686243-590b-46d9-8253-bc4bc801c16f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.635321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e83d7-156e-4cd7-9ec7-b67f5b9c6f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.635917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e83d7-156e-4cd7-9ec7-b67f5b9c6f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.636194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e83d7-156e-4cd7-9ec7-b67f5b9c6f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.636506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e83d7-156e-4cd7-9ec7-b67f5b9c6f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.637132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e83d7-156e-4cd7-9ec7-b67f5b9c6f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.638746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e83d7-156e-4cd7-9ec7-b67f5b9c6f31 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.639131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa03c28-b050-4a54-b2bb-92d70fafdc61 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.643835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1221ed-07da-48d9-b2dd-1ff3ea022f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.644457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1221ed-07da-48d9-b2dd-1ff3ea022f21 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.644772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1221ed-07da-48d9-b2dd-1ff3ea022f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.645011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1221ed-07da-48d9-b2dd-1ff3ea022f21 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.645665 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1221ed-07da-48d9-b2dd-1ff3ea022f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.646672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-1e1221ed-07da-48d9-b2dd-1ff3ea022f21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:11:57.646672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: warnings.warn(msg) Sep 19 12:11:57.646672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: Sep 19 12:11:57.647854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1221ed-07da-48d9-b2dd-1ff3ea022f21 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.650193 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 790/1584] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:57.651152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e83d7-156e-4cd7-9ec7-b67f5b9c6f31 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.666764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e83d7-156e-4cd7-9ec7-b67f5b9c6f31 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.671493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 795/1585] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.674746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1221ed-07da-48d9-b2dd-1ff3ea022f21 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.676043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4d24-08fc-4162-9c9c-1b3ce03dbc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.676660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4d24-08fc-4162-9c9c-1b3ce03dbc62 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.676942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4d24-08fc-4162-9c9c-1b3ce03dbc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.677219 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4d24-08fc-4162-9c9c-1b3ce03dbc62 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.677884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4d24-08fc-4162-9c9c-1b3ce03dbc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.679830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4d24-08fc-4162-9c9c-1b3ce03dbc62 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.684399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1221ed-07da-48d9-b2dd-1ff3ea022f21 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.689481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be4ea4-1bb2-4145-a0f4-83b975a49296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.690119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be4ea4-1bb2-4145-a0f4-83b975a49296 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.690400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be4ea4-1bb2-4145-a0f4-83b975a49296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.690680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be4ea4-1bb2-4145-a0f4-83b975a49296 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.691309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be4ea4-1bb2-4145-a0f4-83b975a49296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.693395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be4ea4-1bb2-4145-a0f4-83b975a49296 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.701321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 791/1586] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/users => generated 283 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.702174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4d24-08fc-4162-9c9c-1b3ce03dbc62 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.712933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4d24-08fc-4162-9c9c-1b3ce03dbc62 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.717581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df829-3719-4ced-b087-676a39299229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.721344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 796/1587] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.721497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df829-3719-4ced-b087-676a39299229 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.721497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df829-3719-4ced-b087-676a39299229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.721497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df829-3719-4ced-b087-676a39299229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.721497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76df829-3719-4ced-b087-676a39299229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.721886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2b17-0687-45c8-8f50-135a3b275a5e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.721886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2b17-0687-45c8-8f50-135a3b275a5e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.721886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2b17-0687-45c8-8f50-135a3b275a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.722137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76df829-3719-4ced-b087-676a39299229 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.731876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 792/1588] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:57.732537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df829-3719-4ced-b087-676a39299229 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.740482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cabe2b17-0687-45c8-8f50-135a3b275a5e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:57.741523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cabe2b17-0687-45c8-8f50-135a3b275a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:57.742629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df829-3719-4ced-b087-676a39299229 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.747175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fd7ab-eddb-489d-8411-0f73d135b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.747749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fd7ab-eddb-489d-8411-0f73d135b475 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.748028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fd7ab-eddb-489d-8411-0f73d135b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.748302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fd7ab-eddb-489d-8411-0f73d135b475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.748923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fd7ab-eddb-489d-8411-0f73d135b475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.749141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 797/1589] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:57.749975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2b17-0687-45c8-8f50-135a3b275a5e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.750521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fd7ab-eddb-489d-8411-0f73d135b475 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.764699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 793/1590] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:57.764699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fd7ab-eddb-489d-8411-0f73d135b475 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.766328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2b17-0687-45c8-8f50-135a3b275a5e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.771321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4349-0253-483b-81aa-97209d8d9a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.771946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4349-0253-483b-81aa-97209d8d9a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.772211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4349-0253-483b-81aa-97209d8d9a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.772484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4349-0253-483b-81aa-97209d8d9a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.773111 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e4349-0253-483b-81aa-97209d8d9a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.774191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fd7ab-eddb-489d-8411-0f73d135b475 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.775030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e4349-0253-483b-81aa-97209d8d9a36 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.778700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ee206-2ad3-4682-904b-644f69150aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.779288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ee206-2ad3-4682-904b-644f69150aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.779571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ee206-2ad3-4682-904b-644f69150aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.779840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ee206-2ad3-4682-904b-644f69150aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.780473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ee206-2ad3-4682-904b-644f69150aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.782139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ee206-2ad3-4682-904b-644f69150aa6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.792090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 794/1591] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:57.793546 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ee206-2ad3-4682-904b-644f69150aa6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.804321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ee206-2ad3-4682-904b-644f69150aa6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.805296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 798/1592] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:57.806128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4349-0253-483b-81aa-97209d8d9a36 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.861567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37967d-3199-43b4-b6f8-3ee11cadf377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.862190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37967d-3199-43b4-b6f8-3ee11cadf377 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.862465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37967d-3199-43b4-b6f8-3ee11cadf377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.862734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37967d-3199-43b4-b6f8-3ee11cadf377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.863359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37967d-3199-43b4-b6f8-3ee11cadf377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.864935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37967d-3199-43b4-b6f8-3ee11cadf377 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.869108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4349-0253-483b-81aa-97209d8d9a36 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.873829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f5cbf-d83c-49f5-a1b2-c2deeeb6d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.874338 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f5cbf-d83c-49f5-a1b2-c2deeeb6d383 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.874616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f5cbf-d83c-49f5-a1b2-c2deeeb6d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.874832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 795/1593] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:57.874943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f5cbf-d83c-49f5-a1b2-c2deeeb6d383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.875686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f5cbf-d83c-49f5-a1b2-c2deeeb6d383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.876445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37967d-3199-43b4-b6f8-3ee11cadf377 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.877919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f5cbf-d83c-49f5-a1b2-c2deeeb6d383 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.885845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37967d-3199-43b4-b6f8-3ee11cadf377 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.887876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 799/1594] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:57.890531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f5cbf-d83c-49f5-a1b2-c2deeeb6d383 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.890649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d8638-3545-447f-af2e-d8d9b0a3d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.891409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8638-3545-447f-af2e-d8d9b0a3d38d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.891693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8638-3545-447f-af2e-d8d9b0a3d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.891947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8638-3545-447f-af2e-d8d9b0a3d38d admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.892786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d8638-3545-447f-af2e-d8d9b0a3d38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.894380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d8638-3545-447f-af2e-d8d9b0a3d38d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.902509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f5cbf-d83c-49f5-a1b2-c2deeeb6d383 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.905683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 796/1595] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:57.906486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d8638-3545-447f-af2e-d8d9b0a3d38d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.907784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ff40e-17ee-4cec-8994-5107a2097e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.908492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ff40e-17ee-4cec-8994-5107a2097e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.908778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ff40e-17ee-4cec-8994-5107a2097e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.909052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ff40e-17ee-4cec-8994-5107a2097e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.909754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ff40e-17ee-4cec-8994-5107a2097e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.911340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ff40e-17ee-4cec-8994-5107a2097e0e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.921679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 800/1596] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:57.925443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ff40e-17ee-4cec-8994-5107a2097e0e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.929822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:57.933261 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ff40e-17ee-4cec-8994-5107a2097e0e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.937881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f27314-3300-4cde-80a9-6a5f4546b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.939299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f27314-3300-4cde-80a9-6a5f4546b845 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.939576 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f27314-3300-4cde-80a9-6a5f4546b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.939843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f27314-3300-4cde-80a9-6a5f4546b845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.940474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f27314-3300-4cde-80a9-6a5f4546b845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.942068 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f27314-3300-4cde-80a9-6a5f4546b845 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.952212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 801/1597] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:57.953037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f27314-3300-4cde-80a9-6a5f4546b845 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:57.962754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f27314-3300-4cde-80a9-6a5f4546b845 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.967300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c8c45-a0cb-4ec6-92c4-29e3babf5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.967928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c8c45-a0cb-4ec6-92c4-29e3babf5d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.968202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c8c45-a0cb-4ec6-92c4-29e3babf5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.968470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c8c45-a0cb-4ec6-92c4-29e3babf5d51 admin admin] PATH_INFO: `/v3/projects/c98e13eabf414dbea2092f44573a0db4/users/cf3436aaf4314c20af0c5816d7809e27/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.969872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d8638-3545-447f-af2e-d8d9b0a3d38d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:57.973610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f968b0-069f-4fff-b73f-d90706ee7ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:57.974238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f968b0-069f-4fff-b73f-d90706ee7ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:57.974518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f968b0-069f-4fff-b73f-d90706ee7ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:57.974792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f968b0-069f-4fff-b73f-d90706ee7ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:57.983377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c8c45-a0cb-4ec6-92c4-29e3babf5d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98e13eabf414dbea2092f44573a0db4, user_id=cf3436aaf4314c20af0c5816d7809e27, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.984329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f968b0-069f-4fff-b73f-d90706ee7ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:57.986477 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f968b0-069f-4fff-b73f-d90706ee7ad3 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.986775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c8c45-a0cb-4ec6-92c4-29e3babf5d51 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:57.989117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:57.997810 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 797/1598] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:11:57.998522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f968b0-069f-4fff-b73f-d90706ee7ad3 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.001846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 802/1599] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:57 2022] PUT /identity/v3/projects/c98e13eabf414dbea2092f44573a0db4/users/cf3436aaf4314c20af0c5816d7809e27/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:58.002605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c8c45-a0cb-4ec6-92c4-29e3babf5d51 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.010513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f968b0-069f-4fff-b73f-d90706ee7ad3 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.075200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c8c45-a0cb-4ec6-92c4-29e3babf5d51 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.078692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bf429-a05b-4a23-94f8-a94548b25460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.079947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf429-a05b-4a23-94f8-a94548b25460 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.080201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf429-a05b-4a23-94f8-a94548b25460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.080458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf429-a05b-4a23-94f8-a94548b25460 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.080869 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fd9eb-4be3-447f-ad77-798eeed8f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.081096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bf429-a05b-4a23-94f8-a94548b25460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.081640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fd9eb-4be3-447f-ad77-798eeed8f252 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.082053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fd9eb-4be3-447f-ad77-798eeed8f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.082585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fd9eb-4be3-447f-ad77-798eeed8f252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.083117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bf429-a05b-4a23-94f8-a94548b25460 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.083483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fd9eb-4be3-447f-ad77-798eeed8f252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.085534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fd9eb-4be3-447f-ad77-798eeed8f252 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.098417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 803/1600] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:58.099383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fd9eb-4be3-447f-ad77-798eeed8f252 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.110334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 798/1601] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:57 2022] POST /identity/v3/users => generated 309 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:58.110334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bf429-a05b-4a23-94f8-a94548b25460 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.114439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fd9eb-4be3-447f-ad77-798eeed8f252 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.118996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bf429-a05b-4a23-94f8-a94548b25460 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.119395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78863108-30ae-4a8d-97a6-c8945da2f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.120074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78863108-30ae-4a8d-97a6-c8945da2f561 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.120417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78863108-30ae-4a8d-97a6-c8945da2f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.120777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78863108-30ae-4a8d-97a6-c8945da2f561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.121469 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78863108-30ae-4a8d-97a6-c8945da2f561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.123205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78863108-30ae-4a8d-97a6-c8945da2f561 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.124618 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96f00d-7df7-4ddb-be4b-e40e63109ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.125290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96f00d-7df7-4ddb-be4b-e40e63109ade admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.126768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96f00d-7df7-4ddb-be4b-e40e63109ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.127519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96f00d-7df7-4ddb-be4b-e40e63109ade admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.128353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96f00d-7df7-4ddb-be4b-e40e63109ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.130193 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96f00d-7df7-4ddb-be4b-e40e63109ade admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.136974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 804/1602] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:58.138421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78863108-30ae-4a8d-97a6-c8945da2f561 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.148160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 799/1603] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:58.148160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96f00d-7df7-4ddb-be4b-e40e63109ade admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.150801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78863108-30ae-4a8d-97a6-c8945da2f561 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.157205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4157b5-c278-4db9-aa08-2013ace94562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.157905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4157b5-c278-4db9-aa08-2013ace94562 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.158343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4157b5-c278-4db9-aa08-2013ace94562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.158623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4157b5-c278-4db9-aa08-2013ace94562 admin admin] PATH_INFO: `/v3/projects/44663db48a29419dae8a3071f76f692a/users/47feadff52c448fd8784e7ea1173ddb8/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.159882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96f00d-7df7-4ddb-be4b-e40e63109ade admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.167498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abca382-cf5c-430d-850d-80fbb4e758d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.167498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abca382-cf5c-430d-850d-80fbb4e758d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.167498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abca382-cf5c-430d-850d-80fbb4e758d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.167837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abca382-cf5c-430d-850d-80fbb4e758d6 admin admin] PATH_INFO: `/v3/projects/1f5af1f919cf41c7ad478e5a03178377/users/e3eb6f1143864d26a759a75f5173c41f/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.178041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4157b5-c278-4db9-aa08-2013ace94562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44663db48a29419dae8a3071f76f692a, user_id=47feadff52c448fd8784e7ea1173ddb8, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.181299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4157b5-c278-4db9-aa08-2013ace94562 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.190923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abca382-cf5c-430d-850d-80fbb4e758d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5af1f919cf41c7ad478e5a03178377, user_id=e3eb6f1143864d26a759a75f5173c41f, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.193770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abca382-cf5c-430d-850d-80fbb4e758d6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.197582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 805/1604] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:58 2022] PUT /identity/v3/projects/44663db48a29419dae8a3071f76f692a/users/47feadff52c448fd8784e7ea1173ddb8/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:58.220067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 800/1605] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:58 2022] PUT /identity/v3/projects/1f5af1f919cf41c7ad478e5a03178377/users/e3eb6f1143864d26a759a75f5173c41f/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:58.220296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56c26c-bbdc-42a2-b5d5-7b0ccdc3bb24 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.220296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56c26c-bbdc-42a2-b5d5-7b0ccdc3bb24 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.220786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abca382-cf5c-430d-850d-80fbb4e758d6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.220864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56c26c-bbdc-42a2-b5d5-7b0ccdc3bb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.244749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2a56c26c-bbdc-42a2-b5d5-7b0ccdc3bb24 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:58.246049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2a56c26c-bbdc-42a2-b5d5-7b0ccdc3bb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:58.303053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abca382-cf5c-430d-850d-80fbb4e758d6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.308211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2799d4-fd6b-4891-92aa-b5a001afd0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.308661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2799d4-fd6b-4891-92aa-b5a001afd0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.308939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2799d4-fd6b-4891-92aa-b5a001afd0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.309363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2799d4-fd6b-4891-92aa-b5a001afd0d4 admin admin] PATH_INFO: `/v3/projects/fdc9177a85454986b3d85c2662f4865c/users/106695be3b344f0bb2072112b0893f8c/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.312350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 806/1606] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:58.313016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56c26c-bbdc-42a2-b5d5-7b0ccdc3bb24 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.323048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56c26c-bbdc-42a2-b5d5-7b0ccdc3bb24 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.328028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f20e93-57b6-4a6e-92d0-bee4dfb101bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.328676 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f20e93-57b6-4a6e-92d0-bee4dfb101bd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.328984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f20e93-57b6-4a6e-92d0-bee4dfb101bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.329261 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f20e93-57b6-4a6e-92d0-bee4dfb101bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.329516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2799d4-fd6b-4891-92aa-b5a001afd0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc9177a85454986b3d85c2662f4865c, user_id=106695be3b344f0bb2072112b0893f8c, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.329937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f20e93-57b6-4a6e-92d0-bee4dfb101bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.331504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f20e93-57b6-4a6e-92d0-bee4dfb101bd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.332277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2799d4-fd6b-4891-92aa-b5a001afd0d4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.341492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:58.346559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 807/1607] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:58.346559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f20e93-57b6-4a6e-92d0-bee4dfb101bd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.349298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 801/1608] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:58 2022] PUT /identity/v3/projects/fdc9177a85454986b3d85c2662f4865c/users/106695be3b344f0bb2072112b0893f8c/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:58.350757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2799d4-fd6b-4891-92aa-b5a001afd0d4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.358273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f20e93-57b6-4a6e-92d0-bee4dfb101bd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.406102 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:58.423386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2799d4-fd6b-4891-92aa-b5a001afd0d4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.435072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448cd8b-3a78-48c8-a892-ca566afb305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.435500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448cd8b-3a78-48c8-a892-ca566afb305e admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.436507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448cd8b-3a78-48c8-a892-ca566afb305e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.436507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448cd8b-3a78-48c8-a892-ca566afb305e admin admin] PATH_INFO: `/v3/projects/813c42fba7c64de2ab580f61da17722b/users/b9e0c29d5cab4fa49e893e5be328f739/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.441967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0debf0-8b42-49a1-884a-1eb54cab3657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.442652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0debf0-8b42-49a1-884a-1eb54cab3657 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.442930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0debf0-8b42-49a1-884a-1eb54cab3657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.443199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0debf0-8b42-49a1-884a-1eb54cab3657 admin admin] PATH_INFO: `/v3/projects/7091ebd30b0349c3bb4cd7b6ecf9d547/users/421b120ee015472bb530542ca9418589/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.459502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448cd8b-3a78-48c8-a892-ca566afb305e admin admin] RBAC: Authorizing `identity:create_grant(project_id=813c42fba7c64de2ab580f61da17722b, user_id=b9e0c29d5cab4fa49e893e5be328f739, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.462969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448cd8b-3a78-48c8-a892-ca566afb305e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.467266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0debf0-8b42-49a1-884a-1eb54cab3657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7091ebd30b0349c3bb4cd7b6ecf9d547, user_id=421b120ee015472bb530542ca9418589, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.471598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0debf0-8b42-49a1-884a-1eb54cab3657 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.481347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 808/1609] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:58 2022] PUT /identity/v3/projects/813c42fba7c64de2ab580f61da17722b/users/b9e0c29d5cab4fa49e893e5be328f739/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:58.483435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e33ab8-4463-407d-a51c-f1a5b62086d5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.484864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e33ab8-4463-407d-a51c-f1a5b62086d5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.485833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e33ab8-4463-407d-a51c-f1a5b62086d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.500677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 802/1610] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:58 2022] PUT /identity/v3/projects/7091ebd30b0349c3bb4cd7b6ecf9d547/users/421b120ee015472bb530542ca9418589/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:58.502831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ac6c2-7fdb-471f-ab3e-b050d8ecde2d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.503126 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ac6c2-7fdb-471f-ab3e-b050d8ecde2d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.503405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ac6c2-7fdb-471f-ab3e-b050d8ecde2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.524788 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c1e33ab8-4463-407d-a51c-f1a5b62086d5 None None] MFA Rules not processed for user `47feadff52c448fd8784e7ea1173ddb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:58.526944 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c1e33ab8-4463-407d-a51c-f1a5b62086d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:58.538251 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5c6ac6c2-7fdb-471f-ab3e-b050d8ecde2d None None] MFA Rules not processed for user `e3eb6f1143864d26a759a75f5173c41f`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:58.539486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5c6ac6c2-7fdb-471f-ab3e-b050d8ecde2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:58.605028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 809/1611] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:58.608698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e33ab8-4463-407d-a51c-f1a5b62086d5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.625085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 803/1612] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:58.626269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ac6c2-7fdb-471f-ab3e-b050d8ecde2d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.673522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e33ab8-4463-407d-a51c-f1a5b62086d5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.678118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2de05-e8cf-4037-9629-7d1a8abbd338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.678762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2de05-e8cf-4037-9629-7d1a8abbd338 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.679350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2de05-e8cf-4037-9629-7d1a8abbd338 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.679852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2de05-e8cf-4037-9629-7d1a8abbd338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.701907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ac6c2-7fdb-471f-ab3e-b050d8ecde2d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.707487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214316fd-597c-4eac-b161-10abdab0f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.708153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214316fd-597c-4eac-b161-10abdab0f4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.708501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214316fd-597c-4eac-b161-10abdab0f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.708842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214316fd-597c-4eac-b161-10abdab0f4ff admin admin] PATH_INFO: `/v3/projects/9a22b1b8d8434edd8e6b5214d90ee4d2/users/9fec81ca51e94cb6884b11e328bec820/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.726948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214316fd-597c-4eac-b161-10abdab0f4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a22b1b8d8434edd8e6b5214d90ee4d2, user_id=9fec81ca51e94cb6884b11e328bec820, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.730266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214316fd-597c-4eac-b161-10abdab0f4ff admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.732751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:58.749008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 804/1613] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:58 2022] PUT /identity/v3/projects/9a22b1b8d8434edd8e6b5214d90ee4d2/users/9fec81ca51e94cb6884b11e328bec820/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:58.749248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2de05-e8cf-4037-9629-7d1a8abbd338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.750275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7d67c-6584-4bdf-986b-4b16d165fff8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.750558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7d67c-6584-4bdf-986b-4b16d165fff8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.750891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7d67c-6584-4bdf-986b-4b16d165fff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.751003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2de05-e8cf-4037-9629-7d1a8abbd338 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.762601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 810/1614] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:11:58.763930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734210-f9da-4a13-aa39-49725d348643 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.764210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734210-f9da-4a13-aa39-49725d348643 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.764480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734210-f9da-4a13-aa39-49725d348643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.773421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-90a7d67c-6584-4bdf-986b-4b16d165fff8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:58.774682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-90a7d67c-6584-4bdf-986b-4b16d165fff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:58.779192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:58.799247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-79734210-f9da-4a13-aa39-49725d348643 None None] MFA Rules not processed for user `b9e0c29d5cab4fa49e893e5be328f739`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:58.800350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-79734210-f9da-4a13-aa39-49725d348643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:58.851066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 805/1615] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:58.852583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33d857-4dd8-445f-81ff-fa8e7397cfec None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.852939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33d857-4dd8-445f-81ff-fa8e7397cfec None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.853282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33d857-4dd8-445f-81ff-fa8e7397cfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.875656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1b33d857-4dd8-445f-81ff-fa8e7397cfec None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:58.877447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1b33d857-4dd8-445f-81ff-fa8e7397cfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:58.888633 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 811/1616] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:58.888633 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734210-f9da-4a13-aa39-49725d348643 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.888912 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 806/1617] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:58.888912 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33d857-4dd8-445f-81ff-fa8e7397cfec None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.903744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33d857-4dd8-445f-81ff-fa8e7397cfec None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.903950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734210-f9da-4a13-aa39-49725d348643 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:58.909410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db9b60-8748-4138-8654-3e4b5f1f6762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.910073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb0986-8509-4576-86f4-c5a463171a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:58.910205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db9b60-8748-4138-8654-3e4b5f1f6762 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.910357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db9b60-8748-4138-8654-3e4b5f1f6762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.910683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db9b60-8748-4138-8654-3e4b5f1f6762 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.910949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb0986-8509-4576-86f4-c5a463171a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:58.911909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb0986-8509-4576-86f4-c5a463171a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:58.912025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db9b60-8748-4138-8654-3e4b5f1f6762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.912123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb0986-8509-4576-86f4-c5a463171a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:58.912445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb0986-8509-4576-86f4-c5a463171a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:58.913562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db9b60-8748-4138-8654-3e4b5f1f6762 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.914701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb0986-8509-4576-86f4-c5a463171a4c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:58.955760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 812/1618] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:58 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:58.957611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb0986-8509-4576-86f4-c5a463171a4c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:58.973603 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 807/1619] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:11:58 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:58.974646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db9b60-8748-4138-8654-3e4b5f1f6762 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.046161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db9b60-8748-4138-8654-3e4b5f1f6762 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.058151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb0986-8509-4576-86f4-c5a463171a4c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.063707 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdcab8-e901-4bfb-9cf3-26df5a91529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.065135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdcab8-e901-4bfb-9cf3-26df5a91529d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.065820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdcab8-e901-4bfb-9cf3-26df5a91529d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.066245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdcab8-e901-4bfb-9cf3-26df5a91529d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.067133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdcab8-e901-4bfb-9cf3-26df5a91529d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.069984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdcab8-e901-4bfb-9cf3-26df5a91529d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.093467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 813/1620] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:59.100025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdcab8-e901-4bfb-9cf3-26df5a91529d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.143670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060f462-861c-4284-8699-5979f4f4ecf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.144718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060f462-861c-4284-8699-5979f4f4ecf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.145326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060f462-861c-4284-8699-5979f4f4ecf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.145715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060f462-861c-4284-8699-5979f4f4ecf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.157924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060f462-861c-4284-8699-5979f4f4ecf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.159541 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060f462-861c-4284-8699-5979f4f4ecf0 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.175589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 808/1621] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:11:59.177155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060f462-861c-4284-8699-5979f4f4ecf0 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.183573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdcab8-e901-4bfb-9cf3-26df5a91529d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.188709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc81d0-9a7a-420b-baf8-14d01c3eaa92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.189439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc81d0-9a7a-420b-baf8-14d01c3eaa92 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.189693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc81d0-9a7a-420b-baf8-14d01c3eaa92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.190008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc81d0-9a7a-420b-baf8-14d01c3eaa92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.217746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc81d0-9a7a-420b-baf8-14d01c3eaa92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.219508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc81d0-9a7a-420b-baf8-14d01c3eaa92 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.221888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:59.233492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 814/1622] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:11:59.235873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc81d0-9a7a-420b-baf8-14d01c3eaa92 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.246890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc81d0-9a7a-420b-baf8-14d01c3eaa92 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.253147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb1161-b104-4faa-84ad-4db284c73fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.254235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1161-b104-4faa-84ad-4db284c73fac admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.254685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1161-b104-4faa-84ad-4db284c73fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.255115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1161-b104-4faa-84ad-4db284c73fac admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.255911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb1161-b104-4faa-84ad-4db284c73fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.259039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060f462-861c-4284-8699-5979f4f4ecf0 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.259194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb1161-b104-4faa-84ad-4db284c73fac admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.266769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877a707-5cb1-46aa-9749-fffaa5d75e40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.267586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877a707-5cb1-46aa-9749-fffaa5d75e40 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.268204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877a707-5cb1-46aa-9749-fffaa5d75e40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.268576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877a707-5cb1-46aa-9749-fffaa5d75e40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.279320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:59.300993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 815/1623] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:59 2022] POST /identity/v3/users => generated 291 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:59.303271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb1161-b104-4faa-84ad-4db284c73fac admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.317357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb1161-b104-4faa-84ad-4db284c73fac admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.323478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94610946-11e6-4af8-8c34-f68b3faa9e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.325738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94610946-11e6-4af8-8c34-f68b3faa9e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.328165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94610946-11e6-4af8-8c34-f68b3faa9e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.328651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94610946-11e6-4af8-8c34-f68b3faa9e82 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.330250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94610946-11e6-4af8-8c34-f68b3faa9e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.344022 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94610946-11e6-4af8-8c34-f68b3faa9e82 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.363455 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877a707-5cb1-46aa-9749-fffaa5d75e40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.366321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877a707-5cb1-46aa-9749-fffaa5d75e40 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.379399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 809/1624] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:11:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:11:59.383283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877a707-5cb1-46aa-9749-fffaa5d75e40 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.384246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 816/1625] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:11:59 2022] POST /identity/v3/users => generated 290 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:11:59.385608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94610946-11e6-4af8-8c34-f68b3faa9e82 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.395422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877a707-5cb1-46aa-9749-fffaa5d75e40 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.401330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94610946-11e6-4af8-8c34-f68b3faa9e82 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.401570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f8c7c-6db0-44f3-a293-a01062e31119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.402683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f8c7c-6db0-44f3-a293-a01062e31119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.403182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f8c7c-6db0-44f3-a293-a01062e31119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.403793 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f8c7c-6db0-44f3-a293-a01062e31119 admin admin] PATH_INFO: `/v3/projects/9a22b1b8d8434edd8e6b5214d90ee4d2/users/9fec81ca51e94cb6884b11e328bec820/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.406536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f8c7c-6db0-44f3-a293-a01062e31119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a22b1b8d8434edd8e6b5214d90ee4d2, user_id=9fec81ca51e94cb6884b11e328bec820, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.409854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f8c7c-6db0-44f3-a293-a01062e31119 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.412166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b14cdc-9652-4695-958a-bf640c434586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.414796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b14cdc-9652-4695-958a-bf640c434586 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.414932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b14cdc-9652-4695-958a-bf640c434586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.415203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b14cdc-9652-4695-958a-bf640c434586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.417408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b14cdc-9652-4695-958a-bf640c434586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.424294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b14cdc-9652-4695-958a-bf640c434586 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.430009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 810/1626] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:59 2022] PUT /identity/v3/projects/9a22b1b8d8434edd8e6b5214d90ee4d2/users/9fec81ca51e94cb6884b11e328bec820/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:59.431328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f8c7c-6db0-44f3-a293-a01062e31119 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.466337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 817/1627] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:59.467385 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601257f-a8f8-4513-841e-a4476cec7066 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.467385 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601257f-a8f8-4513-841e-a4476cec7066 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.469028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601257f-a8f8-4513-841e-a4476cec7066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.547147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d601257f-a8f8-4513-841e-a4476cec7066 None None] MFA Rules not processed for user `9fec81ca51e94cb6884b11e328bec820`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:11:59.549971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d601257f-a8f8-4513-841e-a4476cec7066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:11:59.560163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f8c7c-6db0-44f3-a293-a01062e31119 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.572536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9faa0a-dbe2-415b-871c-e72871abc450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.573552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9faa0a-dbe2-415b-871c-e72871abc450 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.573552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9faa0a-dbe2-415b-871c-e72871abc450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.575464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9faa0a-dbe2-415b-871c-e72871abc450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.575464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9faa0a-dbe2-415b-871c-e72871abc450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.581001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9faa0a-dbe2-415b-871c-e72871abc450 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.606388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 811/1628] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:59.608951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9faa0a-dbe2-415b-871c-e72871abc450 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.630618 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9faa0a-dbe2-415b-871c-e72871abc450 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.646206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f79618-6580-47a5-85c5-761abfb9786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.647055 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79618-6580-47a5-85c5-761abfb9786d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.647452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79618-6580-47a5-85c5-761abfb9786d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.647839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79618-6580-47a5-85c5-761abfb9786d admin admin] PATH_INFO: `/v3/projects/0145ddcd8e944bbdb6c425ca8aa6bbce/users/9486232d99564e63b0a5535e5b9f8a19/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.697245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f79618-6580-47a5-85c5-761abfb9786d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0145ddcd8e944bbdb6c425ca8aa6bbce, user_id=9486232d99564e63b0a5535e5b9f8a19, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.700697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f79618-6580-47a5-85c5-761abfb9786d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.730628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 812/1629] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:59 2022] PUT /identity/v3/projects/0145ddcd8e944bbdb6c425ca8aa6bbce/users/9486232d99564e63b0a5535e5b9f8a19/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:59.736172 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 818/1630] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:11:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:11:59.736172 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601257f-a8f8-4513-841e-a4476cec7066 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.736454 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f79618-6580-47a5-85c5-761abfb9786d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.759110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601257f-a8f8-4513-841e-a4476cec7066 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.809080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:59.852339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f79618-6580-47a5-85c5-761abfb9786d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:11:59.866823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11906263-8472-45fb-b1a0-7799aa4f26ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.869221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11906263-8472-45fb-b1a0-7799aa4f26ac admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.871126 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11906263-8472-45fb-b1a0-7799aa4f26ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.872422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11906263-8472-45fb-b1a0-7799aa4f26ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.873029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11906263-8472-45fb-b1a0-7799aa4f26ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.878856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11906263-8472-45fb-b1a0-7799aa4f26ac admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.903955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12394639-1f00-4242-b872-83752dfe6e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:11:59.903955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12394639-1f00-4242-b872-83752dfe6e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:11:59.907406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 813/1631] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:11:59.907548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12394639-1f00-4242-b872-83752dfe6e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:11:59.907548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12394639-1f00-4242-b872-83752dfe6e9a admin admin] PATH_INFO: `/v3/projects/e3735e03a5c642048bb37ff5ee36b6b0/users/47edbd863fa443d5b83aa57042529154/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:11:59.907728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11906263-8472-45fb-b1a0-7799aa4f26ac admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:11:59.947371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12394639-1f00-4242-b872-83752dfe6e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3735e03a5c642048bb37ff5ee36b6b0, user_id=47edbd863fa443d5b83aa57042529154, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:11:59.950673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12394639-1f00-4242-b872-83752dfe6e9a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:11:59.980278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 819/1632] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:59 2022] PUT /identity/v3/projects/e3735e03a5c642048bb37ff5ee36b6b0/users/47edbd863fa443d5b83aa57042529154/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:11:59.981480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12394639-1f00-4242-b872-83752dfe6e9a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:00.069216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:00.091297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11906263-8472-45fb-b1a0-7799aa4f26ac admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:00.119876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12394639-1f00-4242-b872-83752dfe6e9a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:00.135088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bd9cf-0b5b-44c6-84c3-f16e89860e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:00.135543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bd9cf-0b5b-44c6-84c3-f16e89860e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:00.135795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bd9cf-0b5b-44c6-84c3-f16e89860e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:00.136337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bd9cf-0b5b-44c6-84c3-f16e89860e8d admin admin] PATH_INFO: `/v3/projects/0145ddcd8e944bbdb6c425ca8aa6bbce/users/9486232d99564e63b0a5535e5b9f8a19/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:00.143594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bd9cf-0b5b-44c6-84c3-f16e89860e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0145ddcd8e944bbdb6c425ca8aa6bbce, user_id=9486232d99564e63b0a5535e5b9f8a19, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:00.146254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bd9cf-0b5b-44c6-84c3-f16e89860e8d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:00.185579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 820/1633] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:11:59 2022] PUT /identity/v3/projects/0145ddcd8e944bbdb6c425ca8aa6bbce/users/9486232d99564e63b0a5535e5b9f8a19/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:00.185579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bd9cf-0b5b-44c6-84c3-f16e89860e8d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:00.229120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafcfdb-4107-4132-91c4-a55ae6b0d7c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:00.231491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafcfdb-4107-4132-91c4-a55ae6b0d7c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:00.231491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafcfdb-4107-4132-91c4-a55ae6b0d7c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:00.231675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafcfdb-4107-4132-91c4-a55ae6b0d7c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:00.367339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bd9cf-0b5b-44c6-84c3-f16e89860e8d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:00.389084 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e4e28-948b-4c05-967b-fc7d9e3eb5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:00.391008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4e28-948b-4c05-967b-fc7d9e3eb5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:00.391438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4e28-948b-4c05-967b-fc7d9e3eb5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:00.393035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4e28-948b-4c05-967b-fc7d9e3eb5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:00.394119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e4e28-948b-4c05-967b-fc7d9e3eb5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:00.396321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e4e28-948b-4c05-967b-fc7d9e3eb5b1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:00.414086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafcfdb-4107-4132-91c4-a55ae6b0d7c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:00.416004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafcfdb-4107-4132-91c4-a55ae6b0d7c2 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:00.426598 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 821/1634] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:00.437347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03b1b-3844-4fbe-9c0f-dfd93373965b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:00.438042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03b1b-3844-4fbe-9c0f-dfd93373965b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:00.439279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03b1b-3844-4fbe-9c0f-dfd93373965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:00.449275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 814/1635] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:11:59 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:00.450380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafcfdb-4107-4132-91c4-a55ae6b0d7c2 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:00.467655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafcfdb-4107-4132-91c4-a55ae6b0d7c2 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:00.473680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cb534-104b-4ff1-93f6-71cc77d91bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:00.474369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cb534-104b-4ff1-93f6-71cc77d91bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:00.474768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cb534-104b-4ff1-93f6-71cc77d91bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:00.475049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cb534-104b-4ff1-93f6-71cc77d91bf3 admin admin] PATH_INFO: `/v3/projects/e3735e03a5c642048bb37ff5ee36b6b0/users/47edbd863fa443d5b83aa57042529154/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:00.478244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cb534-104b-4ff1-93f6-71cc77d91bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3735e03a5c642048bb37ff5ee36b6b0, user_id=47edbd863fa443d5b83aa57042529154, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:00.482879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cb534-104b-4ff1-93f6-71cc77d91bf3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:00.510988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 815/1636] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:00 2022] PUT /identity/v3/projects/e3735e03a5c642048bb37ff5ee36b6b0/users/47edbd863fa443d5b83aa57042529154/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:00.513380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94702ae-ea59-4378-9e46-698d7479071d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:00.513697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94702ae-ea59-4378-9e46-698d7479071d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:00.514487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94702ae-ea59-4378-9e46-698d7479071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:00.552318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-03b03b1b-3844-4fbe-9c0f-dfd93373965b None None] MFA Rules not processed for user `9486232d99564e63b0a5535e5b9f8a19`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:00.555145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-03b03b1b-3844-4fbe-9c0f-dfd93373965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:00.577520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f94702ae-ea59-4378-9e46-698d7479071d None None] MFA Rules not processed for user `47edbd863fa443d5b83aa57042529154`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:00.581925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f94702ae-ea59-4378-9e46-698d7479071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:00.606169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:00.731157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 816/1637] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:00.745421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94702ae-ea59-4378-9e46-698d7479071d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:00.751466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 822/1638] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:00.792935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03b1b-3844-4fbe-9c0f-dfd93373965b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:00.865060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94702ae-ea59-4378-9e46-698d7479071d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:00.879298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18efe49-76d2-4b5f-beac-0079f187e742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:00.880844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18efe49-76d2-4b5f-beac-0079f187e742 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:00.882154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18efe49-76d2-4b5f-beac-0079f187e742 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:00.884217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18efe49-76d2-4b5f-beac-0079f187e742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:00.902851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03b1b-3844-4fbe-9c0f-dfd93373965b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:00.911178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18efe49-76d2-4b5f-beac-0079f187e742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:00.916810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f0cb6-8f1a-4016-8562-5dbaa981d319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:00.917381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18efe49-76d2-4b5f-beac-0079f187e742 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:00.921815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0cb6-8f1a-4016-8562-5dbaa981d319 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:00.922114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0cb6-8f1a-4016-8562-5dbaa981d319 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:00.922609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0cb6-8f1a-4016-8562-5dbaa981d319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:00.935610 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:00.946217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f0cb6-8f1a-4016-8562-5dbaa981d319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:00.948212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f0cb6-8f1a-4016-8562-5dbaa981d319 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:00.951722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 817/1639] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:12:00.974661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 823/1640] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:12:01.076631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18efe49-76d2-4b5f-beac-0079f187e742 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:01.093337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18efe49-76d2-4b5f-beac-0079f187e742 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:01.108029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473b61b-97eb-4f53-a8c7-e3b8af274a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:01.112810 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473b61b-97eb-4f53-a8c7-e3b8af274a75 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:01.114693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473b61b-97eb-4f53-a8c7-e3b8af274a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:01.115655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473b61b-97eb-4f53-a8c7-e3b8af274a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:01.254663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473b61b-97eb-4f53-a8c7-e3b8af274a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:01.256018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473b61b-97eb-4f53-a8c7-e3b8af274a75 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:01.277014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 818/1641] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:01.401179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f0cb6-8f1a-4016-8562-5dbaa981d319 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:01.606715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f0cb6-8f1a-4016-8562-5dbaa981d319 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:01.614926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:01.616322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:01.616322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:01.616719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] PATH_INFO: `/v3/users/4877c2635b764dd2a46e9898e4954fa7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:01.618154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4877c2635b764dd2a46e9898e4954fa7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:01.624305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:01.728187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4877c2635b764dd2a46e9898e4954fa7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:01.748040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4877c2635b764dd2a46e9898e4954fa7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:01.748754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4877c2635b764dd2a46e9898e4954fa7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:01.749719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4877c2635b764dd2a46e9898e4954fa7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:01.765097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4877c2635b764dd2a46e9898e4954fa7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:01.804252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 824/1642] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:01 2022] DELETE /identity/v3/users/4877c2635b764dd2a46e9898e4954fa7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:01.808660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f1cce-b0e5-4279-ad18-ffd82323d7b8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:01.809078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f1cce-b0e5-4279-ad18-ffd82323d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:01.809918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f1cce-b0e5-4279-ad18-ffd82323d7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:01.845375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-053f1cce-b0e5-4279-ad18-ffd82323d7b8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:01.848264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-053f1cce-b0e5-4279-ad18-ffd82323d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:01.964910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:01.992053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 819/1643] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:02.046934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:02.049489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:02.200136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e263e38-1be0-40da-b68f-9dd3dc9b3333 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:02.217307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f993c-563c-4ec7-8d15-85f47fb0412f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:02.217883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f993c-563c-4ec7-8d15-85f47fb0412f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:02.218165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f993c-563c-4ec7-8d15-85f47fb0412f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:02.218441 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f993c-563c-4ec7-8d15-85f47fb0412f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:02.240035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f993c-563c-4ec7-8d15-85f47fb0412f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:02.240941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f993c-563c-4ec7-8d15-85f47fb0412f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:02.260040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 825/1644] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:03.245313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592e3d3-7e8d-4719-a636-b57c10159c47 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:03.245966 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592e3d3-7e8d-4719-a636-b57c10159c47 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:03.246326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592e3d3-7e8d-4719-a636-b57c10159c47 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:03.248589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 820/1645] 10.222.0.50 () {54 vars in 965 bytes} [Mon Sep 19 12:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:12:03.259979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98fb35-309d-4fd1-911b-36dcb6cace35 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:03.260602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98fb35-309d-4fd1-911b-36dcb6cace35 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:03.260958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98fb35-309d-4fd1-911b-36dcb6cace35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:03.335572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:03.354992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0a98fb35-309d-4fd1-911b-36dcb6cace35 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:03.357500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0a98fb35-309d-4fd1-911b-36dcb6cace35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:03.566887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc8d0-de1e-4fb7-ae2d-03cb229d6aa9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:03.567663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc8d0-de1e-4fb7-ae2d-03cb229d6aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:03.568129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc8d0-de1e-4fb7-ae2d-03cb229d6aa9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:03.570205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 821/1646] 10.222.0.50 () {54 vars in 912 bytes} [Mon Sep 19 12:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 12:12:03.579800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3380ac5-80e6-4180-8de7-611df3248fd8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:03.580318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3380ac5-80e6-4180-8de7-611df3248fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:03.580978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3380ac5-80e6-4180-8de7-611df3248fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:03.585488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 826/1647] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Sep 19 12:12:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:03.623246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b3380ac5-80e6-4180-8de7-611df3248fd8 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:03.633134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b3380ac5-80e6-4180-8de7-611df3248fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:03.681302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 822/1648] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:12:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:03.750304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98fb35-309d-4fd1-911b-36dcb6cace35 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:03.752299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0a98fb35-309d-4fd1-911b-36dcb6cace35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:03.949049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98fb35-309d-4fd1-911b-36dcb6cace35 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:03.960424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726578c-01d4-4642-8759-fc02735e0a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:03.961249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726578c-01d4-4642-8759-fc02735e0a91 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:03.961528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726578c-01d4-4642-8759-fc02735e0a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:03.961838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726578c-01d4-4642-8759-fc02735e0a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:03.976785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726578c-01d4-4642-8759-fc02735e0a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:03.978649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726578c-01d4-4642-8759-fc02735e0a91 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:04.021637 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 827/1649] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:04.394113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3380ac5-80e6-4180-8de7-611df3248fd8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:04.395999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b3380ac5-80e6-4180-8de7-611df3248fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:04.439926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3380ac5-80e6-4180-8de7-611df3248fd8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:04.456151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:04.464926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:04.465731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:04.469983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] PATH_INFO: `/v3/projects/481ae03223e14b4b9311e03e2d15e9b8` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:04.472224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=481ae03223e14b4b9311e03e2d15e9b8)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:04.478838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:04.623273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481ae03223e14b4b9311e03e2d15e9b8', 'request_id': 'req-094a6430-cf8a-44a9-ab74-a359f95162d8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:04.653492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481ae03223e14b4b9311e03e2d15e9b8', 'request_id': 'req-094a6430-cf8a-44a9-ab74-a359f95162d8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:04.678356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481ae03223e14b4b9311e03e2d15e9b8', 'request_id': 'req-094a6430-cf8a-44a9-ab74-a359f95162d8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:04.706176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] The token cache is being invalidate because project 481ae03223e14b4b9311e03e2d15e9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:04.706664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:04.710970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:04.714794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 823/1650] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:04 2022] DELETE /identity/v3/projects/481ae03223e14b4b9311e03e2d15e9b8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:04.737646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726578c-01d4-4642-8759-fc02735e0a91 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:04.774889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726578c-01d4-4642-8759-fc02735e0a91 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:04.901093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:04.902422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:04.903420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:04.903718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] PATH_INFO: `/v3/users/9fec81ca51e94cb6884b11e328bec820` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:04.905410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fec81ca51e94cb6884b11e328bec820)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:04.908306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:04.985801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:04.996291 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fec81ca51e94cb6884b11e328bec820'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:05.013490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fec81ca51e94cb6884b11e328bec820'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:05.014363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fec81ca51e94cb6884b11e328bec820'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:05.015629 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fec81ca51e94cb6884b11e328bec820'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:05.031455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a2aa2caf-05f6-4ec4-a1e9-86898a161d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fec81ca51e94cb6884b11e328bec820'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:05.075461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 828/1651] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:04 2022] DELETE /identity/v3/users/9fec81ca51e94cb6884b11e328bec820 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:05.324683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:05.326187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:05.351766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a6430-cf8a-44a9-ab74-a359f95162d8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:05.483914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:05.484622 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:05.486891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:05.487329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] PATH_INFO: `/v3/users/47feadff52c448fd8784e7ea1173ddb8` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:05.490015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=47feadff52c448fd8784e7ea1173ddb8)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:05.492768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:12:05.492768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: warnings.warn(msg) Sep 19 12:12:05.492768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: Sep 19 12:12:05.494116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:05.660054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47feadff52c448fd8784e7ea1173ddb8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:05.677977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47feadff52c448fd8784e7ea1173ddb8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:05.678819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47feadff52c448fd8784e7ea1173ddb8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:05.679461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47feadff52c448fd8784e7ea1173ddb8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:05.700493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47feadff52c448fd8784e7ea1173ddb8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:05.732800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:05.816984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 824/1652] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:05 2022] DELETE /identity/v3/users/47feadff52c448fd8784e7ea1173ddb8 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:05.818462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd8429-bbda-44c0-9556-c1484f2efda2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:05.819041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd8429-bbda-44c0-9556-c1484f2efda2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:05.819041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd8429-bbda-44c0-9556-c1484f2efda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:05.863234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d5bd8429-bbda-44c0-9556-c1484f2efda2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:05.864453 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d5bd8429-bbda-44c0-9556-c1484f2efda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:06.026307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 829/1653] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:06.045166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:06.052016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:06.218580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933225-d0f7-4ee6-be20-7f4a0c5fe72f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:06.232631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906815b4-af40-4b60-8428-8f6e14f16e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:06.235965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906815b4-af40-4b60-8428-8f6e14f16e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:06.235965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906815b4-af40-4b60-8428-8f6e14f16e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:06.235965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906815b4-af40-4b60-8428-8f6e14f16e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:06.257709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906815b4-af40-4b60-8428-8f6e14f16e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:06.262207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906815b4-af40-4b60-8428-8f6e14f16e12 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:06.292332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 825/1654] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:06.534678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8c880-69c5-4df2-b3c5-9a57d30cfb9f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:06.535162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8c880-69c5-4df2-b3c5-9a57d30cfb9f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:06.535273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8c880-69c5-4df2-b3c5-9a57d30cfb9f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:06.536721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 830/1655] 10.222.0.50 () {54 vars in 965 bytes} [Mon Sep 19 12:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:12:06.552399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ba09d-13e4-48b3-95b5-e5616cb05166 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:06.552853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ba09d-13e4-48b3-95b5-e5616cb05166 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:06.552938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ba09d-13e4-48b3-95b5-e5616cb05166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:06.603933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-235ba09d-13e4-48b3-95b5-e5616cb05166 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:06.605438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-235ba09d-13e4-48b3-95b5-e5616cb05166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:06.840864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 826/1656] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Sep 19 12:12:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:06.846648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4057dd-6abe-4914-9e38-a7ace2f7602c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:06.847155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4057dd-6abe-4914-9e38-a7ace2f7602c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:06.847247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4057dd-6abe-4914-9e38-a7ace2f7602c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:06.848780 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 831/1657] 10.222.0.50 () {54 vars in 912 bytes} [Mon Sep 19 12:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 12:12:06.854162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d17588-7d9d-4ded-a359-bfe97d99d3dd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:06.854706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d17588-7d9d-4ded-a359-bfe97d99d3dd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:06.854989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d17588-7d9d-4ded-a359-bfe97d99d3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:06.910157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c8d17588-7d9d-4ded-a359-bfe97d99d3dd None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:06.916547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c8d17588-7d9d-4ded-a359-bfe97d99d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:06.947183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 827/1658] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:12:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:06.974928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4057dd-6abe-4914-9e38-a7ace2f7602c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:06.977013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ae4057dd-6abe-4914-9e38-a7ace2f7602c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:06.991040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d17588-7d9d-4ded-a359-bfe97d99d3dd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:06.992793 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c8d17588-7d9d-4ded-a359-bfe97d99d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:07.041870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d17588-7d9d-4ded-a359-bfe97d99d3dd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:07.057655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:07.058035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:07.060170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:07.061301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] PATH_INFO: `/v3/users/e3eb6f1143864d26a759a75f5173c41f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:07.069959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3eb6f1143864d26a759a75f5173c41f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:07.072015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:07.073112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4057dd-6abe-4914-9e38-a7ace2f7602c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:07.081080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e9351-8e0f-4c9a-9e0d-a121f772a14b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:07.082386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e9351-8e0f-4c9a-9e0d-a121f772a14b service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:07.083095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e9351-8e0f-4c9a-9e0d-a121f772a14b service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:07.083389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e9351-8e0f-4c9a-9e0d-a121f772a14b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:07.096481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e9351-8e0f-4c9a-9e0d-a121f772a14b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:07.098614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e9351-8e0f-4c9a-9e0d-a121f772a14b service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:07.132209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 832/1659] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:07.210291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3eb6f1143864d26a759a75f5173c41f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:07.223696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3eb6f1143864d26a759a75f5173c41f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:07.224462 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3eb6f1143864d26a759a75f5173c41f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:07.225284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3eb6f1143864d26a759a75f5173c41f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:07.264394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3eb6f1143864d26a759a75f5173c41f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:07.287347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:07.335766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52577-62bb-4c49-ade9-a4c5bd236628 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:07.336375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52577-62bb-4c49-ade9-a4c5bd236628 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:07.336862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52577-62bb-4c49-ade9-a4c5bd236628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:07.342018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 828/1660] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:06 2022] DELETE /identity/v3/users/e3eb6f1143864d26a759a75f5173c41f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:12:07.396083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-40a52577-62bb-4c49-ade9-a4c5bd236628 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:07.398570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-40a52577-62bb-4c49-ade9-a4c5bd236628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:07.538019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:07.560009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 833/1661] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:07.606761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:07.609371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:07.624855 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a52577-62bb-4c49-ade9-a4c5bd236628 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:07.629210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-40a52577-62bb-4c49-ade9-a4c5bd236628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:07.655657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664570e9-d0bf-43f9-a9c0-f73fb89d8341 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:07.675356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:07.676009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:07.676283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:07.677223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] PATH_INFO: `/v3/projects/9a22b1b8d8434edd8e6b5214d90ee4d2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:07.678826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a22b1b8d8434edd8e6b5214d90ee4d2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:07.684448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:07.823885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a52577-62bb-4c49-ade9-a4c5bd236628 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:07.843383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a22b1b8d8434edd8e6b5214d90ee4d2', 'request_id': 'req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:07.871601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a22b1b8d8434edd8e6b5214d90ee4d2', 'request_id': 'req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:07.909159 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a22b1b8d8434edd8e6b5214d90ee4d2', 'request_id': 'req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:07.950402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] The token cache is being invalidate because project 9a22b1b8d8434edd8e6b5214d90ee4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:07.950402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:07.950402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ccb60cf9-ae5f-4e36-b5b1-b8aed423a6b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:07.969875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 829/1662] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:07 2022] DELETE /identity/v3/projects/9a22b1b8d8434edd8e6b5214d90ee4d2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:07.983546 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfedc-c95e-4099-9867-b5e9db424606 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:07.983855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfedc-c95e-4099-9867-b5e9db424606 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:07.984140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfedc-c95e-4099-9867-b5e9db424606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:08.040211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807975-d58d-40f1-b435-6b2a4f1385cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:08.043315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807975-d58d-40f1-b435-6b2a4f1385cb service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:08.045106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807975-d58d-40f1-b435-6b2a4f1385cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:08.045407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807975-d58d-40f1-b435-6b2a4f1385cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:08.062409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-83807975-d58d-40f1-b435-6b2a4f1385cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:08.104089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ae6bfedc-c95e-4099-9867-b5e9db424606 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:08.105609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ae6bfedc-c95e-4099-9867-b5e9db424606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:08.293888 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807975-d58d-40f1-b435-6b2a4f1385cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:08.295801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807975-d58d-40f1-b435-6b2a4f1385cb service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:08.324871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 830/1663] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:08.333374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 834/1664] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:12:08.334865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fdcae-7c33-436d-b38a-427b25fe66d9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:08.335322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fdcae-7c33-436d-b38a-427b25fe66d9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:08.335743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fdcae-7c33-436d-b38a-427b25fe66d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:08.360854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3d1fdcae-7c33-436d-b38a-427b25fe66d9 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:08.362354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3d1fdcae-7c33-436d-b38a-427b25fe66d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:08.379505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 831/1665] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:08.385645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807975-d58d-40f1-b435-6b2a4f1385cb service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:08.402388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807975-d58d-40f1-b435-6b2a4f1385cb service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:08.415597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff49e7-5838-4aae-ba63-f38fe1e59191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:08.417230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff49e7-5838-4aae-ba63-f38fe1e59191 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:08.417230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff49e7-5838-4aae-ba63-f38fe1e59191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:08.417230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff49e7-5838-4aae-ba63-f38fe1e59191 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:08.417473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff49e7-5838-4aae-ba63-f38fe1e59191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:08.417757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff49e7-5838-4aae-ba63-f38fe1e59191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:08.419670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff49e7-5838-4aae-ba63-f38fe1e59191 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:08.456047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 835/1666] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:08.457577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fdcae-7c33-436d-b38a-427b25fe66d9 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:08.472470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fdcae-7c33-436d-b38a-427b25fe66d9 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:08.478301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f758a-b903-40f3-904c-f809257f7e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:08.478939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f758a-b903-40f3-904c-f809257f7e8f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:08.479219 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f758a-b903-40f3-904c-f809257f7e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:08.479749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f758a-b903-40f3-904c-f809257f7e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:08.480404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f758a-b903-40f3-904c-f809257f7e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:08.482442 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f758a-b903-40f3-904c-f809257f7e8f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:08.545308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 832/1667] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:08 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:08.548370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff49e7-5838-4aae-ba63-f38fe1e59191 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:08.565936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff49e7-5838-4aae-ba63-f38fe1e59191 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:08.693989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:08.719975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff14b91-d85b-4464-80ab-b3a69e8c4efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:08.721728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff14b91-d85b-4464-80ab-b3a69e8c4efe admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:08.722022 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff14b91-d85b-4464-80ab-b3a69e8c4efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:08.722656 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff14b91-d85b-4464-80ab-b3a69e8c4efe admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:08.724937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff14b91-d85b-4464-80ab-b3a69e8c4efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:08.727961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff14b91-d85b-4464-80ab-b3a69e8c4efe admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:08.785593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 836/1668] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:08 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:08.787804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f758a-b903-40f3-904c-f809257f7e8f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:08.804398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f758a-b903-40f3-904c-f809257f7e8f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:08.815499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232e89d-8767-47ed-9374-9111e227d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:08.816141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e89d-8767-47ed-9374-9111e227d28a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:08.816426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e89d-8767-47ed-9374-9111e227d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:08.816707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e89d-8767-47ed-9374-9111e227d28a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:08.818010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232e89d-8767-47ed-9374-9111e227d28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:08.819037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232e89d-8767-47ed-9374-9111e227d28a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:08.847688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 833/1669] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:08.852003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff14b91-d85b-4464-80ab-b3a69e8c4efe admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:08.865832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff14b91-d85b-4464-80ab-b3a69e8c4efe admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:08.882448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0705c-d165-4b2a-a300-b47b3d5fcb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:08.882910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0705c-d165-4b2a-a300-b47b3d5fcb2c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:08.883214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0705c-d165-4b2a-a300-b47b3d5fcb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:08.883467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0705c-d165-4b2a-a300-b47b3d5fcb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:08.884119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0705c-d165-4b2a-a300-b47b3d5fcb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:08.886460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0705c-d165-4b2a-a300-b47b3d5fcb2c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:08.915845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 837/1670] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:08.917369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232e89d-8767-47ed-9374-9111e227d28a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:08.935693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232e89d-8767-47ed-9374-9111e227d28a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:08.946294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122ad90-109f-4c3b-ab73-1fffc9513e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:08.946644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122ad90-109f-4c3b-ab73-1fffc9513e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:08.947482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122ad90-109f-4c3b-ab73-1fffc9513e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:08.947482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122ad90-109f-4c3b-ab73-1fffc9513e99 admin admin] PATH_INFO: `/v3/projects/0f4997cb257b407da8957e164aa874ff/users/d49503cae2954f09a6a7531f21520973/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:08.977980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122ad90-109f-4c3b-ab73-1fffc9513e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4997cb257b407da8957e164aa874ff, user_id=d49503cae2954f09a6a7531f21520973, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:08.980540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122ad90-109f-4c3b-ab73-1fffc9513e99 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:09.010996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 834/1671] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:08 2022] PUT /identity/v3/projects/0f4997cb257b407da8957e164aa874ff/users/d49503cae2954f09a6a7531f21520973/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:09.021816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecf1be-9133-4c95-8545-9b5be67ee57d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:09.022105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecf1be-9133-4c95-8545-9b5be67ee57d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:09.022375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecf1be-9133-4c95-8545-9b5be67ee57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:09.036882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122ad90-109f-4c3b-ab73-1fffc9513e99 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:09.038913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9122ad90-109f-4c3b-ab73-1fffc9513e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:09.055831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:09.096799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-80ecf1be-9133-4c95-8545-9b5be67ee57d None None] MFA Rules not processed for user `d49503cae2954f09a6a7531f21520973`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:09.102029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-80ecf1be-9133-4c95-8545-9b5be67ee57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:09.182464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122ad90-109f-4c3b-ab73-1fffc9513e99 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:09.199291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:09.199936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:09.200185 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:09.200452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] PATH_INFO: `/v3/projects/44663db48a29419dae8a3071f76f692a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:09.201612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44663db48a29419dae8a3071f76f692a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:09.204183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:09.235686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 838/1672] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:09.240128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecf1be-9133-4c95-8545-9b5be67ee57d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:09.255493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecf1be-9133-4c95-8545-9b5be67ee57d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:09.270657 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509d9a5-1957-49fe-b136-8421b715f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:09.272829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509d9a5-1957-49fe-b136-8421b715f22b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:09.273767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509d9a5-1957-49fe-b136-8421b715f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:09.279924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509d9a5-1957-49fe-b136-8421b715f22b admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:09.282489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509d9a5-1957-49fe-b136-8421b715f22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:09.288312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509d9a5-1957-49fe-b136-8421b715f22b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:09.341917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44663db48a29419dae8a3071f76f692a', 'request_id': 'req-0a994ddc-c43d-4220-9448-89efbe9d2db2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:09.358917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 839/1673] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:09 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:12:09.360451 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509d9a5-1957-49fe-b136-8421b715f22b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:09.366363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44663db48a29419dae8a3071f76f692a', 'request_id': 'req-0a994ddc-c43d-4220-9448-89efbe9d2db2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:09.397295 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44663db48a29419dae8a3071f76f692a', 'request_id': 'req-0a994ddc-c43d-4220-9448-89efbe9d2db2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:09.424323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] The token cache is being invalidate because project 44663db48a29419dae8a3071f76f692a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:09.424628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:09.426607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:09.430388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 835/1674] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:09 2022] DELETE /identity/v3/projects/44663db48a29419dae8a3071f76f692a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:12:09.446965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:09.450173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:09.507723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509d9a5-1957-49fe-b136-8421b715f22b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:09.524611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3880b0c-acf6-4dd3-a5c5-859a963a1d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:09.525270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3880b0c-acf6-4dd3-a5c5-859a963a1d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:09.525546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3880b0c-acf6-4dd3-a5c5-859a963a1d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:09.529051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3880b0c-acf6-4dd3-a5c5-859a963a1d96 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:09.532757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3880b0c-acf6-4dd3-a5c5-859a963a1d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:09.536539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3880b0c-acf6-4dd3-a5c5-859a963a1d96 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:09.610831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 840/1675] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:09 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:09.612086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3880b0c-acf6-4dd3-a5c5-859a963a1d96 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:09.634345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d3880b0c-acf6-4dd3-a5c5-859a963a1d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:09.701222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a994ddc-c43d-4220-9448-89efbe9d2db2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:09.705837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3880b0c-acf6-4dd3-a5c5-859a963a1d96 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:09.718147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e74ae-8853-42db-871e-405ca50ef3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:09.719121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e74ae-8853-42db-871e-405ca50ef3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:09.719830 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e74ae-8853-42db-871e-405ca50ef3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:09.720269 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e74ae-8853-42db-871e-405ca50ef3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:09.721255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e74ae-8853-42db-871e-405ca50ef3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:09.723261 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e74ae-8853-42db-871e-405ca50ef3e5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:09.725718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:09.726390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:09.726674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:09.726953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] PATH_INFO: `/v3/users/9486232d99564e63b0a5535e5b9f8a19` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:09.733659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9486232d99564e63b0a5535e5b9f8a19)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:09.736843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:09.769188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 841/1676] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:09.770549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e74ae-8853-42db-871e-405ca50ef3e5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:09.800388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e74ae-8853-42db-871e-405ca50ef3e5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:09.815474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92d0b-77eb-4394-acfa-1db7f66ac258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:09.821012 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92d0b-77eb-4394-acfa-1db7f66ac258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:09.822756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92d0b-77eb-4394-acfa-1db7f66ac258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:09.823270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92d0b-77eb-4394-acfa-1db7f66ac258 admin admin] PATH_INFO: `/v3/projects/8dd10840c2224ff29996dc86c617699b/users/998608c3610b48b385e7412670305b02/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:09.879224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:09.890787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9486232d99564e63b0a5535e5b9f8a19'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:09.911597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9486232d99564e63b0a5535e5b9f8a19'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:09.912258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9486232d99564e63b0a5535e5b9f8a19'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:09.912961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9486232d99564e63b0a5535e5b9f8a19'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:09.925795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a92d0b-77eb-4394-acfa-1db7f66ac258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd10840c2224ff29996dc86c617699b, user_id=998608c3610b48b385e7412670305b02, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:09.928564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a92d0b-77eb-4394-acfa-1db7f66ac258 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:09.931074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:09.933265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9486232d99564e63b0a5535e5b9f8a19'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:09.959160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 842/1677] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:09 2022] PUT /identity/v3/projects/8dd10840c2224ff29996dc86c617699b/users/998608c3610b48b385e7412670305b02/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:09.963209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92d0b-77eb-4394-acfa-1db7f66ac258 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:09.967756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-30a92d0b-77eb-4394-acfa-1db7f66ac258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:09.980269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 836/1678] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:09 2022] DELETE /identity/v3/users/9486232d99564e63b0a5535e5b9f8a19 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:10.112737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92d0b-77eb-4394-acfa-1db7f66ac258 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:10.197325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce770e4-8f9d-434b-804b-f739f377ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:10.197857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce770e4-8f9d-434b-804b-f739f377ad5f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:10.198136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce770e4-8f9d-434b-804b-f739f377ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:10.198410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce770e4-8f9d-434b-804b-f739f377ad5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:10.199058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce770e4-8f9d-434b-804b-f739f377ad5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:10.200846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce770e4-8f9d-434b-804b-f739f377ad5f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:10.232158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 843/1679] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:10.236094 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:10.324942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a4dd-6af8-4972-a5a5-df6e76b8d49a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:10.362155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3558f-7854-41a7-8cb7-cdb6edf124c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:10.362862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3558f-7854-41a7-8cb7-cdb6edf124c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:10.363141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3558f-7854-41a7-8cb7-cdb6edf124c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:10.363416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3558f-7854-41a7-8cb7-cdb6edf124c2 admin admin] PATH_INFO: `/v3/projects/8dd10840c2224ff29996dc86c617699b/users/998608c3610b48b385e7412670305b02/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:10.375304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3558f-7854-41a7-8cb7-cdb6edf124c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd10840c2224ff29996dc86c617699b, user_id=998608c3610b48b385e7412670305b02, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:10.380112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3558f-7854-41a7-8cb7-cdb6edf124c2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:10.428493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 837/1680] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:10 2022] PUT /identity/v3/projects/8dd10840c2224ff29996dc86c617699b/users/998608c3610b48b385e7412670305b02/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:10.438376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf5341-825c-4b92-87a2-beb406292243 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:10.438716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf5341-825c-4b92-87a2-beb406292243 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:10.438992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf5341-825c-4b92-87a2-beb406292243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:10.520373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3caf5341-825c-4b92-87a2-beb406292243 None None] MFA Rules not processed for user `998608c3610b48b385e7412670305b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:10.521874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3caf5341-825c-4b92-87a2-beb406292243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:10.721959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 844/1681] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:10.739034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3558f-7854-41a7-8cb7-cdb6edf124c2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:10.741125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a9e3558f-7854-41a7-8cb7-cdb6edf124c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:10.899143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3558f-7854-41a7-8cb7-cdb6edf124c2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:10.910048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf5341-825c-4b92-87a2-beb406292243 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:10.911970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3caf5341-825c-4b92-87a2-beb406292243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:10.923934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c01a6-1711-414a-9bf0-e47097ce0659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:10.924849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c01a6-1711-414a-9bf0-e47097ce0659 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:10.925438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c01a6-1711-414a-9bf0-e47097ce0659 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:10.925894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c01a6-1711-414a-9bf0-e47097ce0659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:10.947163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c01a6-1711-414a-9bf0-e47097ce0659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:10.951303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c01a6-1711-414a-9bf0-e47097ce0659 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:10.967144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:10.985435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 838/1682] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:11.077795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf5341-825c-4b92-87a2-beb406292243 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:11.083550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:11.084626 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:11.085085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:11.085445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] PATH_INFO: `/v3/projects/1f5af1f919cf41c7ad478e5a03178377` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:11.088107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5af1f919cf41c7ad478e5a03178377)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:11.089051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 12:12:11.089051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: warnings.warn(msg) Sep 19 12:12:11.089051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: Sep 19 12:12:11.093486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:11.202411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c01a6-1711-414a-9bf0-e47097ce0659 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:11.204750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-953c01a6-1711-414a-9bf0-e47097ce0659 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:11.224485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5af1f919cf41c7ad478e5a03178377', 'request_id': 'req-8307028a-0fa6-4723-8574-3a542c80aab7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:11.225954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c01a6-1711-414a-9bf0-e47097ce0659 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:11.246880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5af1f919cf41c7ad478e5a03178377', 'request_id': 'req-8307028a-0fa6-4723-8574-3a542c80aab7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:11.259184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5af1f919cf41c7ad478e5a03178377', 'request_id': 'req-8307028a-0fa6-4723-8574-3a542c80aab7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:11.304570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] The token cache is being invalidate because project 1f5af1f919cf41c7ad478e5a03178377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:11.304795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:11.307827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:11.309790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 845/1683] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:10 2022] DELETE /identity/v3/projects/1f5af1f919cf41c7ad478e5a03178377 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:11.314095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:11.317369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:11.379463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddeee1-cb70-4878-a57c-cc724d23cd65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:11.380898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddeee1-cb70-4878-a57c-cc724d23cd65 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:11.382856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddeee1-cb70-4878-a57c-cc724d23cd65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:11.383289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddeee1-cb70-4878-a57c-cc724d23cd65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:11.387309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-84ddeee1-cb70-4878-a57c-cc724d23cd65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:11.461422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307028a-0fa6-4723-8574-3a542c80aab7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:11.477504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:11.478271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:11.478553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:11.478965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] PATH_INFO: `/v3/users/47edbd863fa443d5b83aa57042529154` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:11.482914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47edbd863fa443d5b83aa57042529154)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:11.485599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:11.555613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddeee1-cb70-4878-a57c-cc724d23cd65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:11.557793 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddeee1-cb70-4878-a57c-cc724d23cd65 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:11.583057 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 839/1684] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:11.598185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47edbd863fa443d5b83aa57042529154'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:11.613089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47edbd863fa443d5b83aa57042529154'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:11.616213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47edbd863fa443d5b83aa57042529154'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:11.616213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47edbd863fa443d5b83aa57042529154'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:11.616421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:11.631875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47edbd863fa443d5b83aa57042529154'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:11.671807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 846/1685] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:11 2022] DELETE /identity/v3/users/47edbd863fa443d5b83aa57042529154 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:12:11.762973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d2a0d-e7ac-44a6-9f57-5e3871b04102 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:11.763401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d2a0d-e7ac-44a6-9f57-5e3871b04102 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:11.763787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d2a0d-e7ac-44a6-9f57-5e3871b04102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:11.773689 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:11.846895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-702d2a0d-e7ac-44a6-9f57-5e3871b04102 None None] MFA Rules not processed for user `2bb68c40e4964cb0b3d74fdf9d91cb2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:11.848406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-702d2a0d-e7ac-44a6-9f57-5e3871b04102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:12.008112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 840/1686] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:12.023679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:12.025409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:12.209056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395d894-73ad-4c06-b1da-12f4c1019204 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:12.215940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf081-a15e-41fd-a1c1-e4b25734198e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:12.216281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf081-a15e-41fd-a1c1-e4b25734198e service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:12.216566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf081-a15e-41fd-a1c1-e4b25734198e service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:12.217997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf081-a15e-41fd-a1c1-e4b25734198e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:12.247398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebf081-a15e-41fd-a1c1-e4b25734198e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:12.250014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebf081-a15e-41fd-a1c1-e4b25734198e service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:12.274985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 847/1687] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:12.455196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3968d5-834b-4d35-90f9-03fe525655dc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:12.456134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3968d5-834b-4d35-90f9-03fe525655dc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:12.456714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3968d5-834b-4d35-90f9-03fe525655dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:12.493599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9a3968d5-834b-4d35-90f9-03fe525655dc None None] MFA Rules not processed for user `cf3436aaf4314c20af0c5816d7809e27`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:12.495533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9a3968d5-834b-4d35-90f9-03fe525655dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:12.680930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf081-a15e-41fd-a1c1-e4b25734198e service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:12.680930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c4ebf081-a15e-41fd-a1c1-e4b25734198e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:12.683262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 841/1688] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:12.685060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d9dc-0070-4599-ad65-f3aeabc0c392 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:12.685814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d9dc-0070-4599-ad65-f3aeabc0c392 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:12.686294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d9dc-0070-4599-ad65-f3aeabc0c392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:12.715527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d981d9dc-0070-4599-ad65-f3aeabc0c392 None None] MFA Rules not processed for user `cf3436aaf4314c20af0c5816d7809e27`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:12.716686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d981d9dc-0070-4599-ad65-f3aeabc0c392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:12.728532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 842/1689] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:12.744716 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d9dc-0070-4599-ad65-f3aeabc0c392 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:12.747985 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d981d9dc-0070-4599-ad65-f3aeabc0c392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:12.809194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d9dc-0070-4599-ad65-f3aeabc0c392 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:12.820305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef548a-681a-471d-b99e-6c4e059b58df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:12.821266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef548a-681a-471d-b99e-6c4e059b58df service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:12.821725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef548a-681a-471d-b99e-6c4e059b58df service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:12.822108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef548a-681a-471d-b99e-6c4e059b58df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:12.834246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef548a-681a-471d-b99e-6c4e059b58df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:12.836699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef548a-681a-471d-b99e-6c4e059b58df service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:12.860459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 843/1690] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:12.877975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf081-a15e-41fd-a1c1-e4b25734198e service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:12.890493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:12.893736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:12.894190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:12.894581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] PATH_INFO: `/v3/projects/0145ddcd8e944bbdb6c425ca8aa6bbce` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:12.896402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0145ddcd8e944bbdb6c425ca8aa6bbce)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:12.905378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:13.009005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0145ddcd8e944bbdb6c425ca8aa6bbce', 'request_id': 'req-56fe4155-652b-465d-8d1f-7d201895a386'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:13.027293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0145ddcd8e944bbdb6c425ca8aa6bbce', 'request_id': 'req-56fe4155-652b-465d-8d1f-7d201895a386'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:13.031263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:13.040753 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0145ddcd8e944bbdb6c425ca8aa6bbce', 'request_id': 'req-56fe4155-652b-465d-8d1f-7d201895a386'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:13.082359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] The token cache is being invalidate because project 0145ddcd8e944bbdb6c425ca8aa6bbce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:13.082729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:13.083937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56fe4155-652b-465d-8d1f-7d201895a386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:13.095896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8ef7-338f-40fc-8e4e-8d43075656fd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:13.096363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8ef7-338f-40fc-8e4e-8d43075656fd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:13.096621 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8ef7-338f-40fc-8e4e-8d43075656fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:13.105430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 848/1691] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:12 2022] DELETE /identity/v3/projects/0145ddcd8e944bbdb6c425ca8aa6bbce => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:13.172259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f9af8ef7-338f-40fc-8e4e-8d43075656fd None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:13.175164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f9af8ef7-338f-40fc-8e4e-8d43075656fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:13.384605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 844/1692] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:13.393656 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b4a22-7626-4ccc-9460-fc8b4aaf503f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:13.394157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b4a22-7626-4ccc-9460-fc8b4aaf503f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:13.394227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b4a22-7626-4ccc-9460-fc8b4aaf503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:13.420839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af8ef7-338f-40fc-8e4e-8d43075656fd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:13.423413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f9af8ef7-338f-40fc-8e4e-8d43075656fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:13.431674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:13.444908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af8ef7-338f-40fc-8e4e-8d43075656fd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:13.451336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cc7b4a22-7626-4ccc-9460-fc8b4aaf503f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:13.452583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc7b4a22-7626-4ccc-9460-fc8b4aaf503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:13.458664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:13.459498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:13.459978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:13.460457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] PATH_INFO: `/v3/projects/e3735e03a5c642048bb37ff5ee36b6b0` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:13.464851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3735e03a5c642048bb37ff5ee36b6b0)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:13.469842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:13.491563 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 849/1693] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:13.496008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b4a22-7626-4ccc-9460-fc8b4aaf503f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:13.519337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b4a22-7626-4ccc-9460-fc8b4aaf503f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:13.544642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f1fc9-4b85-4049-96c5-ced4aa68e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:13.546005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f1fc9-4b85-4049-96c5-ced4aa68e6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:13.546289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f1fc9-4b85-4049-96c5-ced4aa68e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:13.546649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f1fc9-4b85-4049-96c5-ced4aa68e6c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:13.548530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f1fc9-4b85-4049-96c5-ced4aa68e6c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:13.549030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f1fc9-4b85-4049-96c5-ced4aa68e6c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:13.557801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f1fc9-4b85-4049-96c5-ced4aa68e6c0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:13.596493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3735e03a5c642048bb37ff5ee36b6b0', 'request_id': 'req-749f4248-3178-4dea-b5bc-484ef7601398'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:13.610354 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 850/1694] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:12:13.613888 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f1fc9-4b85-4049-96c5-ced4aa68e6c0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:13.631572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3735e03a5c642048bb37ff5ee36b6b0', 'request_id': 'req-749f4248-3178-4dea-b5bc-484ef7601398'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:13.647772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3735e03a5c642048bb37ff5ee36b6b0', 'request_id': 'req-749f4248-3178-4dea-b5bc-484ef7601398'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:13.647944 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f1fc9-4b85-4049-96c5-ced4aa68e6c0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:13.674637 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] The token cache is being invalidate because project e3735e03a5c642048bb37ff5ee36b6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:13.677516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:13.678614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-749f4248-3178-4dea-b5bc-484ef7601398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:13.682972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 845/1695] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:13 2022] DELETE /identity/v3/projects/e3735e03a5c642048bb37ff5ee36b6b0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:13.695756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa15b7-4ac8-4af4-8518-b6484d885a0c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:13.697857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa15b7-4ac8-4af4-8518-b6484d885a0c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:13.698668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa15b7-4ac8-4af4-8518-b6484d885a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:13.771292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-80fa15b7-4ac8-4af4-8518-b6484d885a0c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:13.775663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-80fa15b7-4ac8-4af4-8518-b6484d885a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:13.893411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e0d98-11d4-4a5d-98a3-607bfa645647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:13.894089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e0d98-11d4-4a5d-98a3-607bfa645647 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:13.894376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e0d98-11d4-4a5d-98a3-607bfa645647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:13.894648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e0d98-11d4-4a5d-98a3-607bfa645647 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:13.895300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e0d98-11d4-4a5d-98a3-607bfa645647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:13.898174 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e0d98-11d4-4a5d-98a3-607bfa645647 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:14.006944 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 851/1696] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:13 2022] POST /identity/v3/projects => generated 385 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:14.010611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e0d98-11d4-4a5d-98a3-607bfa645647 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:14.014388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ff8e0d98-11d4-4a5d-98a3-607bfa645647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:14.142679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 846/1697] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:14.155377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0326b34-e1ae-4df0-8eba-53254fa03931 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.155679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0326b34-e1ae-4df0-8eba-53254fa03931 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.155943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0326b34-e1ae-4df0-8eba-53254fa03931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.212284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e0d98-11d4-4a5d-98a3-607bfa645647 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:14.226158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3abb3-4e9a-4e88-896b-d0d014e34b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:14.228331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3abb3-4e9a-4e88-896b-d0d014e34b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.229750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3abb3-4e9a-4e88-896b-d0d014e34b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.230744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3abb3-4e9a-4e88-896b-d0d014e34b8b admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.234225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3abb3-4e9a-4e88-896b-d0d014e34b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:14.241973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3abb3-4e9a-4e88-896b-d0d014e34b8b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:14.246475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c0326b34-e1ae-4df0-8eba-53254fa03931 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:14.252351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c0326b34-e1ae-4df0-8eba-53254fa03931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:14.288493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 852/1698] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:14 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:14.292895 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3abb3-4e9a-4e88-896b-d0d014e34b8b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:14.315678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 847/1699] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:14.321047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0326b34-e1ae-4df0-8eba-53254fa03931 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:14.321489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3abb3-4e9a-4e88-896b-d0d014e34b8b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:14.332500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9741c-037c-4ab2-92b7-e003e1637dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:14.334305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9741c-037c-4ab2-92b7-e003e1637dab admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.335766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9741c-037c-4ab2-92b7-e003e1637dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.335766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9741c-037c-4ab2-92b7-e003e1637dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.338295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9741c-037c-4ab2-92b7-e003e1637dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:14.345452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9741c-037c-4ab2-92b7-e003e1637dab admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:14.360699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0326b34-e1ae-4df0-8eba-53254fa03931 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:14.373979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846bf87-cfcd-4993-9334-b3a5fbe7c401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:14.374619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846bf87-cfcd-4993-9334-b3a5fbe7c401 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.377442 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846bf87-cfcd-4993-9334-b3a5fbe7c401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.377803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846bf87-cfcd-4993-9334-b3a5fbe7c401 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.379080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846bf87-cfcd-4993-9334-b3a5fbe7c401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:14.383207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 853/1700] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:14.383446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846bf87-cfcd-4993-9334-b3a5fbe7c401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:14.385011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9741c-037c-4ab2-92b7-e003e1637dab admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:14.389740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846bf87-cfcd-4993-9334-b3a5fbe7c401 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:14.412722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9741c-037c-4ab2-92b7-e003e1637dab admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:14.431529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013ea90-2b06-450a-a878-d2f7a5d7f23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:14.432169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013ea90-2b06-450a-a878-d2f7a5d7f23e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.432454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013ea90-2b06-450a-a878-d2f7a5d7f23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.432732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013ea90-2b06-450a-a878-d2f7a5d7f23e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.433438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013ea90-2b06-450a-a878-d2f7a5d7f23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:14.440347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 848/1701] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:14.441329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846bf87-cfcd-4993-9334-b3a5fbe7c401 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:14.445465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013ea90-2b06-450a-a878-d2f7a5d7f23e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:14.471260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 854/1702] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:14.475633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846bf87-cfcd-4993-9334-b3a5fbe7c401 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:14.476379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bb6ca-18bb-40d7-86fa-5b9807d142a8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.476671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bb6ca-18bb-40d7-86fa-5b9807d142a8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.478038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bb6ca-18bb-40d7-86fa-5b9807d142a8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.487819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 855/1703] 10.222.0.50 () {54 vars in 912 bytes} [Mon Sep 19 12:12:14 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:12:14.488971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bb6ca-18bb-40d7-86fa-5b9807d142a8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:14.490390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb309b-7360-431b-96c7-e539fae658e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:14.491038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb309b-7360-431b-96c7-e539fae658e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.492719 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb309b-7360-431b-96c7-e539fae658e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.493048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb309b-7360-431b-96c7-e539fae658e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.494890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb309b-7360-431b-96c7-e539fae658e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:14.501536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb309b-7360-431b-96c7-e539fae658e2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:14.520574 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bb6ca-18bb-40d7-86fa-5b9807d142a8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:14.538178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cfe27-b92e-482d-8578-23c204f07e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:14.539071 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cfe27-b92e-482d-8578-23c204f07e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.539359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cfe27-b92e-482d-8578-23c204f07e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.539647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cfe27-b92e-482d-8578-23c204f07e65 admin admin] PATH_INFO: `/v3/projects/114b2e5c6227416fa54bacb3fbfcffda/users/0cab2f2d114141d18372124cc0aadaca/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.580040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cfe27-b92e-482d-8578-23c204f07e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114b2e5c6227416fa54bacb3fbfcffda, user_id=0cab2f2d114141d18372124cc0aadaca, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:14.582746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cfe27-b92e-482d-8578-23c204f07e65 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:14.585482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 849/1704] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:14 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:14.588939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdf8ac-9407-4cdb-940e-abfb14c62213 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.590123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdf8ac-9407-4cdb-940e-abfb14c62213 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.590522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdf8ac-9407-4cdb-940e-abfb14c62213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.593997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:14.619249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 856/1705] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:14 2022] PUT /identity/v3/projects/114b2e5c6227416fa54bacb3fbfcffda/users/0cab2f2d114141d18372124cc0aadaca/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:14.622530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cfe27-b92e-482d-8578-23c204f07e65 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:14.734565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f4fdf8ac-9407-4cdb-940e-abfb14c62213 None None] MFA Rules not processed for user `4fe0dabaf0ef4fc7b417d378334413c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:14.737143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f4fdf8ac-9407-4cdb-940e-abfb14c62213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:14.778430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cfe27-b92e-482d-8578-23c204f07e65 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:14.792877 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a6539-df9e-4202-bbfd-aad414fb726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:14.793640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a6539-df9e-4202-bbfd-aad414fb726f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.793928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a6539-df9e-4202-bbfd-aad414fb726f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.794207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a6539-df9e-4202-bbfd-aad414fb726f admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.794855 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a6539-df9e-4202-bbfd-aad414fb726f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:14.796791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a6539-df9e-4202-bbfd-aad414fb726f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:14.800291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:14.856158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 857/1706] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:14 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:14.856158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4f64-8597-4d82-bb8f-f7d1643a5600 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.856158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4f64-8597-4d82-bb8f-f7d1643a5600 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.856158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4f64-8597-4d82-bb8f-f7d1643a5600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.882885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 850/1707] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:12:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:14.884067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdf8ac-9407-4cdb-940e-abfb14c62213 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:14.913076 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdf8ac-9407-4cdb-940e-abfb14c62213 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:14.928152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c2a79-230e-41c0-8cd3-9dccb6a6edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:14.928785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c2a79-230e-41c0-8cd3-9dccb6a6edaa admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:14.929064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c2a79-230e-41c0-8cd3-9dccb6a6edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:14.929334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c2a79-230e-41c0-8cd3-9dccb6a6edaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:14.930034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c2a79-230e-41c0-8cd3-9dccb6a6edaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:14.931646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c2a79-230e-41c0-8cd3-9dccb6a6edaa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:14.936788 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-257f4f64-8597-4d82-bb8f-f7d1643a5600 None None] MFA Rules not processed for user `0cab2f2d114141d18372124cc0aadaca`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:14.941403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-257f4f64-8597-4d82-bb8f-f7d1643a5600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:14.952594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 851/1708] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:14.953363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c2a79-230e-41c0-8cd3-9dccb6a6edaa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:14.968720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2b8c2a79-230e-41c0-8cd3-9dccb6a6edaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:15.003470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c2a79-230e-41c0-8cd3-9dccb6a6edaa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:15.011938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eddf67-1ec5-4071-bdcb-d011c30ed3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:15.014524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eddf67-1ec5-4071-bdcb-d011c30ed3ab service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:15.015681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eddf67-1ec5-4071-bdcb-d011c30ed3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:15.018705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eddf67-1ec5-4071-bdcb-d011c30ed3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:15.039321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eddf67-1ec5-4071-bdcb-d011c30ed3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:15.040779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eddf67-1ec5-4071-bdcb-d011c30ed3ab service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:15.060492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 852/1709] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:15.061357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eddf67-1ec5-4071-bdcb-d011c30ed3ab service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:15.090109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eddf67-1ec5-4071-bdcb-d011c30ed3ab service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:15.099880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 858/1710] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:15.103882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bdc74-eb0e-4e52-a3c9-7974a02c2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:15.104989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bdc74-eb0e-4e52-a3c9-7974a02c2be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:15.105275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bdc74-eb0e-4e52-a3c9-7974a02c2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:15.105558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bdc74-eb0e-4e52-a3c9-7974a02c2be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:15.106844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4f64-8597-4d82-bb8f-f7d1643a5600 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:15.108762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bdc74-eb0e-4e52-a3c9-7974a02c2be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:15.110968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bdc74-eb0e-4e52-a3c9-7974a02c2be9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:15.121098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4f64-8597-4d82-bb8f-f7d1643a5600 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:15.127904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e200e-3263-4a79-9c51-ee83a9d64751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:15.128924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e200e-3263-4a79-9c51-ee83a9d64751 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:15.129424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e200e-3263-4a79-9c51-ee83a9d64751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:15.129946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e200e-3263-4a79-9c51-ee83a9d64751 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:15.131739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e200e-3263-4a79-9c51-ee83a9d64751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:15.145670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e200e-3263-4a79-9c51-ee83a9d64751 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:15.153138 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 853/1711] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:15.154602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bdc74-eb0e-4e52-a3c9-7974a02c2be9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:15.194085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bdc74-eb0e-4e52-a3c9-7974a02c2be9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:15.210737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acf3dd-39f7-4084-a08c-863b8db242e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:15.211207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf3dd-39f7-4084-a08c-863b8db242e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:15.211489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf3dd-39f7-4084-a08c-863b8db242e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:15.211766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf3dd-39f7-4084-a08c-863b8db242e8 admin admin] PATH_INFO: `/v3/projects/2ca9cfd7fe6b4652b5c7cb30ae7e1a8d/users/852928671a9f44dba51f72bb4c29073a/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:15.225316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 859/1712] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:15 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:15.228052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e200e-3263-4a79-9c51-ee83a9d64751 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:15.231216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e58e200e-3263-4a79-9c51-ee83a9d64751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:15.255992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acf3dd-39f7-4084-a08c-863b8db242e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca9cfd7fe6b4652b5c7cb30ae7e1a8d, user_id=852928671a9f44dba51f72bb4c29073a, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:15.260194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acf3dd-39f7-4084-a08c-863b8db242e8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:15.304362 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 854/1713] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:15 2022] PUT /identity/v3/projects/2ca9cfd7fe6b4652b5c7cb30ae7e1a8d/users/852928671a9f44dba51f72bb4c29073a/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:15.315154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acf3dd-39f7-4084-a08c-863b8db242e8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:15.351805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:15.375216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e200e-3263-4a79-9c51-ee83a9d64751 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:15.481103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acf3dd-39f7-4084-a08c-863b8db242e8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:15.505059 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62340c-015b-49b1-b8a6-e5443252fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:15.506097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62340c-015b-49b1-b8a6-e5443252fc8b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:15.506203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62340c-015b-49b1-b8a6-e5443252fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:15.506507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62340c-015b-49b1-b8a6-e5443252fc8b admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:15.507119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62340c-015b-49b1-b8a6-e5443252fc8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:15.509239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62340c-015b-49b1-b8a6-e5443252fc8b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:15.591077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 855/1714] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:15 2022] POST /identity/v3/users => generated 300 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:15.592444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41573ee7-405d-42f6-889d-2a980cedc219 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:15.592747 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41573ee7-405d-42f6-889d-2a980cedc219 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:15.593055 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41573ee7-405d-42f6-889d-2a980cedc219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:15.727130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:15.730786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:15.733704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:15.735303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] PATH_INFO: `/v3/users/b9e0c29d5cab4fa49e893e5be328f739` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:15.747533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e0c29d5cab4fa49e893e5be328f739)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:15.768521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:15.869683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-41573ee7-405d-42f6-889d-2a980cedc219 None None] MFA Rules not processed for user `852928671a9f44dba51f72bb4c29073a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:15.870960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-41573ee7-405d-42f6-889d-2a980cedc219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:15.998949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e0c29d5cab4fa49e893e5be328f739'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:16.018193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e0c29d5cab4fa49e893e5be328f739'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:16.020964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e0c29d5cab4fa49e893e5be328f739'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:16.022325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e0c29d5cab4fa49e893e5be328f739'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:16.061286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e0c29d5cab4fa49e893e5be328f739'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:16.135420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 860/1715] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:15 2022] DELETE /identity/v3/users/b9e0c29d5cab4fa49e893e5be328f739 => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:16.140269 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:16.149034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:16.402425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:16.423344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b12384-fe33-4169-8ab3-00d257468382 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:16.424151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 856/1716] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 833 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:16.431713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973a35e-8668-4c17-97d1-d2bbeea0a4de None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:16.432190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973a35e-8668-4c17-97d1-d2bbeea0a4de None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:16.432670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973a35e-8668-4c17-97d1-d2bbeea0a4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:16.447658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96677-788d-4088-8047-d76e2f688903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:16.448297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96677-788d-4088-8047-d76e2f688903 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:16.448578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96677-788d-4088-8047-d76e2f688903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:16.448848 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96677-788d-4088-8047-d76e2f688903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:16.449503 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d96677-788d-4088-8047-d76e2f688903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:16.451208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d96677-788d-4088-8047-d76e2f688903 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:16.484328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 861/1717] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:16.488516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96677-788d-4088-8047-d76e2f688903 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:16.495735 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-10d96677-788d-4088-8047-d76e2f688903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:16.506570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5973a35e-8668-4c17-97d1-d2bbeea0a4de None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:16.514781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5973a35e-8668-4c17-97d1-d2bbeea0a4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:16.555806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96677-788d-4088-8047-d76e2f688903 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:16.561605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 857/1718] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:16.564289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973a35e-8668-4c17-97d1-d2bbeea0a4de None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:16.578996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1d3b6-9ae7-49e4-b988-0e74242e6a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:16.579626 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d3b6-9ae7-49e4-b988-0e74242e6a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:16.579900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d3b6-9ae7-49e4-b988-0e74242e6a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:16.580166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d3b6-9ae7-49e4-b988-0e74242e6a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:16.580801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1d3b6-9ae7-49e4-b988-0e74242e6a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:16.582720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1d3b6-9ae7-49e4-b988-0e74242e6a1b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:16.644604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973a35e-8668-4c17-97d1-d2bbeea0a4de None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:16.645758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:16.689938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 862/1719] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:16 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:16.690935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1d3b6-9ae7-49e4-b988-0e74242e6a1b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:16.695518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146d57-7da2-4fd0-9da3-c71ee9b347ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:16.698515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146d57-7da2-4fd0-9da3-c71ee9b347ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:16.698986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146d57-7da2-4fd0-9da3-c71ee9b347ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:16.699435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146d57-7da2-4fd0-9da3-c71ee9b347ea admin admin] PATH_INFO: `/v3/projects/b3cdeee2522e4e1d9e352f39114a629f/users/630849f28255483ebb02d4cc93f1c60c/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:16.699721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0cc1d3b6-9ae7-49e4-b988-0e74242e6a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:16.819154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c146d57-7da2-4fd0-9da3-c71ee9b347ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cdeee2522e4e1d9e352f39114a629f, user_id=630849f28255483ebb02d4cc93f1c60c, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:16.825052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c146d57-7da2-4fd0-9da3-c71ee9b347ea admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:16.879794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 858/1720] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:16 2022] PUT /identity/v3/projects/b3cdeee2522e4e1d9e352f39114a629f/users/630849f28255483ebb02d4cc93f1c60c/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:16.880637 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146d57-7da2-4fd0-9da3-c71ee9b347ea admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:16.912889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1d3b6-9ae7-49e4-b988-0e74242e6a1b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:17.032906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e95fbd-01a3-435f-b38d-c470b0dc9e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:17.033925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e95fbd-01a3-435f-b38d-c470b0dc9e87 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:17.034356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e95fbd-01a3-435f-b38d-c470b0dc9e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:17.034637 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e95fbd-01a3-435f-b38d-c470b0dc9e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:17.040357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146d57-7da2-4fd0-9da3-c71ee9b347ea admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:17.054760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e95fbd-01a3-435f-b38d-c470b0dc9e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:17.055000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b33674-adad-4ba0-b820-fde59e2e211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:17.055604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b33674-adad-4ba0-b820-fde59e2e211d admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:17.055883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b33674-adad-4ba0-b820-fde59e2e211d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:17.056157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b33674-adad-4ba0-b820-fde59e2e211d admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:17.056265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e95fbd-01a3-435f-b38d-c470b0dc9e87 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:17.056795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b33674-adad-4ba0-b820-fde59e2e211d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:17.058737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b33674-adad-4ba0-b820-fde59e2e211d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:17.083202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 863/1721] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:17.085267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e95fbd-01a3-435f-b38d-c470b0dc9e87 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:17.110627 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e95fbd-01a3-435f-b38d-c470b0dc9e87 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:17.122114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7804ba-5a62-4695-993a-0b7b0ca26839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:17.123009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7804ba-5a62-4695-993a-0b7b0ca26839 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:17.123551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7804ba-5a62-4695-993a-0b7b0ca26839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:17.123961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7804ba-5a62-4695-993a-0b7b0ca26839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:17.124809 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7804ba-5a62-4695-993a-0b7b0ca26839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:17.127567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7804ba-5a62-4695-993a-0b7b0ca26839 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:17.131451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 859/1722] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:16 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:17.132614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b33674-adad-4ba0-b820-fde59e2e211d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:17.138237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-07b33674-adad-4ba0-b820-fde59e2e211d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:17.144258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 864/1723] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:17.145946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff0723-92ab-469a-8ac0-cf00572c139f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:17.146425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff0723-92ab-469a-8ac0-cf00572c139f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:17.147122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff0723-92ab-469a-8ac0-cf00572c139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:17.181273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b6ff0723-92ab-469a-8ac0-cf00572c139f None None] MFA Rules not processed for user `cf3436aaf4314c20af0c5816d7809e27`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:17.182624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b6ff0723-92ab-469a-8ac0-cf00572c139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:17.320881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b33674-adad-4ba0-b820-fde59e2e211d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:17.364390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84acf35-1d69-4e4e-baa2-dcdfe287410a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:17.369134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84acf35-1d69-4e4e-baa2-dcdfe287410a service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:17.371597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84acf35-1d69-4e4e-baa2-dcdfe287410a service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:17.372449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84acf35-1d69-4e4e-baa2-dcdfe287410a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:17.377594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c84acf35-1d69-4e4e-baa2-dcdfe287410a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:17.379254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 865/1724] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:17.381721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff0723-92ab-469a-8ac0-cf00572c139f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:17.450596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff0723-92ab-469a-8ac0-cf00572c139f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:17.458958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84acf35-1d69-4e4e-baa2-dcdfe287410a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:17.461065 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84acf35-1d69-4e4e-baa2-dcdfe287410a service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:17.475321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e458c0-f70b-416c-8671-52d77e344624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:17.477475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e458c0-f70b-416c-8671-52d77e344624 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:17.481167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e458c0-f70b-416c-8671-52d77e344624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:17.481406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e458c0-f70b-416c-8671-52d77e344624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:17.482347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e458c0-f70b-416c-8671-52d77e344624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:17.486912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e458c0-f70b-416c-8671-52d77e344624 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:17.499132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 860/1725] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:17.502358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84acf35-1d69-4e4e-baa2-dcdfe287410a service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:17.513965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 866/1726] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:17.517844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e458c0-f70b-416c-8671-52d77e344624 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:17.549406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84acf35-1d69-4e4e-baa2-dcdfe287410a service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:17.562365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a493cd-e126-4896-b4c5-290d46512e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:17.563839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a493cd-e126-4896-b4c5-290d46512e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:17.564225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a493cd-e126-4896-b4c5-290d46512e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:17.564576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a493cd-e126-4896-b4c5-290d46512e21 admin admin] PATH_INFO: `/v3/projects/b3cdeee2522e4e1d9e352f39114a629f/users/630849f28255483ebb02d4cc93f1c60c/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:17.568421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a493cd-e126-4896-b4c5-290d46512e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cdeee2522e4e1d9e352f39114a629f, user_id=630849f28255483ebb02d4cc93f1c60c, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:17.571240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a493cd-e126-4896-b4c5-290d46512e21 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:17.585439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e458c0-f70b-416c-8671-52d77e344624 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:17.589764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 861/1727] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:17 2022] PUT /identity/v3/projects/b3cdeee2522e4e1d9e352f39114a629f/users/630849f28255483ebb02d4cc93f1c60c/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:17.603605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38144-54c2-49fb-a091-72fb35937bae None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:17.603996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38144-54c2-49fb-a091-72fb35937bae None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:17.604349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38144-54c2-49fb-a091-72fb35937bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:17.679764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:17.689868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-95b38144-54c2-49fb-a091-72fb35937bae None None] MFA Rules not processed for user `630849f28255483ebb02d4cc93f1c60c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:17.691376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-95b38144-54c2-49fb-a091-72fb35937bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:17.734572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb354e2e-0837-4eda-97af-c1542c73acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:17.737116 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354e2e-0837-4eda-97af-c1542c73acd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:17.737567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354e2e-0837-4eda-97af-c1542c73acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:17.738913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354e2e-0837-4eda-97af-c1542c73acd8 admin admin] PATH_INFO: `/v3/projects/89f22cde3624479ebba8b2cb54c54e8a/users/ccabcc84b874443f9868b0f2553113cb/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:17.744939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:17.767157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb354e2e-0837-4eda-97af-c1542c73acd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f22cde3624479ebba8b2cb54c54e8a, user_id=ccabcc84b874443f9868b0f2553113cb, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:17.771901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb354e2e-0837-4eda-97af-c1542c73acd8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:17.797432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 867/1728] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:17 2022] PUT /identity/v3/projects/89f22cde3624479ebba8b2cb54c54e8a/users/ccabcc84b874443f9868b0f2553113cb/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:17.801988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb354e2e-0837-4eda-97af-c1542c73acd8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:17.855633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 862/1729] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:17.864491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b38144-54c2-49fb-a091-72fb35937bae None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:17.865954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-95b38144-54c2-49fb-a091-72fb35937bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:17.958626 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb354e2e-0837-4eda-97af-c1542c73acd8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:17.967224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0473aad-6d3f-4c09-a8da-8e5291a4c98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:17.967869 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0473aad-6d3f-4c09-a8da-8e5291a4c98d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:17.968155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0473aad-6d3f-4c09-a8da-8e5291a4c98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:17.968431 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0473aad-6d3f-4c09-a8da-8e5291a4c98d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:17.969880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0473aad-6d3f-4c09-a8da-8e5291a4c98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:17.971783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0473aad-6d3f-4c09-a8da-8e5291a4c98d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:17.997593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 868/1730] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:18.009606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0473aad-6d3f-4c09-a8da-8e5291a4c98d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:18.025033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0473aad-6d3f-4c09-a8da-8e5291a4c98d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:18.047760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b38144-54c2-49fb-a091-72fb35937bae None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:18.050490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de669466-5ca1-4390-a924-4f93dcb96a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:18.062175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de669466-5ca1-4390-a924-4f93dcb96a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:18.062467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de669466-5ca1-4390-a924-4f93dcb96a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:18.063558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de669466-5ca1-4390-a924-4f93dcb96a35 admin admin] PATH_INFO: `/v3/projects/89f22cde3624479ebba8b2cb54c54e8a/users/ccabcc84b874443f9868b0f2553113cb/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:18.065899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de669466-5ca1-4390-a924-4f93dcb96a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f22cde3624479ebba8b2cb54c54e8a, user_id=ccabcc84b874443f9868b0f2553113cb, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:18.069185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de669466-5ca1-4390-a924-4f93dcb96a35 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:18.118587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 869/1731] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:18 2022] PUT /identity/v3/projects/89f22cde3624479ebba8b2cb54c54e8a/users/ccabcc84b874443f9868b0f2553113cb/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:18.120842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013616d-201a-473e-a62d-e6bb81abbb04 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:18.121138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013616d-201a-473e-a62d-e6bb81abbb04 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:18.121929 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013616d-201a-473e-a62d-e6bb81abbb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:18.167144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b1da8-618a-4e62-a0c9-52eecad46207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:18.167737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b1da8-618a-4e62-a0c9-52eecad46207 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:18.168018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b1da8-618a-4e62-a0c9-52eecad46207 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:18.168296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b1da8-618a-4e62-a0c9-52eecad46207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:18.225330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3013616d-201a-473e-a62d-e6bb81abbb04 None None] MFA Rules not processed for user `ccabcc84b874443f9868b0f2553113cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:18.226927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3013616d-201a-473e-a62d-e6bb81abbb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:18.364721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b1da8-618a-4e62-a0c9-52eecad46207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:18.374736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b1da8-618a-4e62-a0c9-52eecad46207 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:18.428595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 863/1732] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:18.448566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 870/1733] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:18.462276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b1da8-618a-4e62-a0c9-52eecad46207 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:18.485485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013616d-201a-473e-a62d-e6bb81abbb04 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:18.499511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b1da8-618a-4e62-a0c9-52eecad46207 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:18.549993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:18.637396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:18.639968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:18.641728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:18.641999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] PATH_INFO: `/v3/users/0cab2f2d114141d18372124cc0aadaca` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:18.642781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:18.646727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cab2f2d114141d18372124cc0aadaca)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:18.652782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:18.770784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013616d-201a-473e-a62d-e6bb81abbb04 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:18.779503 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80bac9-8bbd-4066-af9f-d22158e329ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:18.780400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bac9-8bbd-4066-af9f-d22158e329ca service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:18.780687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bac9-8bbd-4066-af9f-d22158e329ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:18.781551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bac9-8bbd-4066-af9f-d22158e329ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:18.786410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cab2f2d114141d18372124cc0aadaca'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:18.818007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cab2f2d114141d18372124cc0aadaca'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:18.819684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cab2f2d114141d18372124cc0aadaca'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:18.820444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cab2f2d114141d18372124cc0aadaca'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:18.851527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80bac9-8bbd-4066-af9f-d22158e329ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:18.852938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cab2f2d114141d18372124cc0aadaca'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:18.856527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80bac9-8bbd-4066-af9f-d22158e329ca service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:18.889009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 871/1734] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:18.893338 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40840f7-1eec-49db-9ed8-bc7941f8153e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:18.893671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40840f7-1eec-49db-9ed8-bc7941f8153e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:18.893939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40840f7-1eec-49db-9ed8-bc7941f8153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:18.916432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 864/1735] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:18 2022] DELETE /identity/v3/users/0cab2f2d114141d18372124cc0aadaca => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:12:18.921836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:18.934027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:18.958586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a40840f7-1eec-49db-9ed8-bc7941f8153e None None] MFA Rules not processed for user `2bb68c40e4964cb0b3d74fdf9d91cb2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:18.961211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a40840f7-1eec-49db-9ed8-bc7941f8153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:19.147395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 872/1736] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:19.148872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2593b82-9664-439b-ae51-391cfcac438f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:19.149164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2593b82-9664-439b-ae51-391cfcac438f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:19.149459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2593b82-9664-439b-ae51-391cfcac438f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:19.191159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c2593b82-9664-439b-ae51-391cfcac438f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:19.196475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c2593b82-9664-439b-ae51-391cfcac438f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:19.219941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701ff4d-2e87-4279-a53c-6029e8898d77 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:19.235491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 873/1737] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:19.245444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:19.246433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:19.246926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:19.253336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] PATH_INFO: `/v3/projects/813c42fba7c64de2ab580f61da17722b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:19.256625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813c42fba7c64de2ab580f61da17722b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:19.258665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:19.275284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2593b82-9664-439b-ae51-391cfcac438f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:19.276817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c2593b82-9664-439b-ae51-391cfcac438f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:19.435236 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2593b82-9664-439b-ae51-391cfcac438f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:19.450221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:19.457256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813c42fba7c64de2ab580f61da17722b', 'request_id': 'req-a65739b9-ee11-46f4-9d76-e2a8833124a0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:19.479722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813c42fba7c64de2ab580f61da17722b', 'request_id': 'req-a65739b9-ee11-46f4-9d76-e2a8833124a0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:19.505659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813c42fba7c64de2ab580f61da17722b', 'request_id': 'req-a65739b9-ee11-46f4-9d76-e2a8833124a0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:19.531724 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04653a-ab45-424e-a7f2-feae3688ed55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:19.532509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04653a-ab45-424e-a7f2-feae3688ed55 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:19.532890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04653a-ab45-424e-a7f2-feae3688ed55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:19.533394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04653a-ab45-424e-a7f2-feae3688ed55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:19.570051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] The token cache is being invalidate because project 813c42fba7c64de2ab580f61da17722b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:19.571197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:19.573731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a65739b9-ee11-46f4-9d76-e2a8833124a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:19.580212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 865/1738] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:18 2022] DELETE /identity/v3/projects/813c42fba7c64de2ab580f61da17722b => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:19.585071 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90b254-ce16-4c05-9067-485e47dae8d0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:19.585657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90b254-ce16-4c05-9067-485e47dae8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:19.586138 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90b254-ce16-4c05-9067-485e47dae8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:19.644835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6a90b254-ce16-4c05-9067-485e47dae8d0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:19.646633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6a90b254-ce16-4c05-9067-485e47dae8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:19.708087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:19.788262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04653a-ab45-424e-a7f2-feae3688ed55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:19.793479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04653a-ab45-424e-a7f2-feae3688ed55 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:19.851782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 874/1739] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:12:19.879741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6478b-f57c-4afb-9f16-a5bdbfe2fdeb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:19.880505 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6478b-f57c-4afb-9f16-a5bdbfe2fdeb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:19.888702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6478b-f57c-4afb-9f16-a5bdbfe2fdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:19.903394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 866/1740] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:19.912474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756c36a-2623-492e-99e6-8b264822012f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:19.912831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756c36a-2623-492e-99e6-8b264822012f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:19.913038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756c36a-2623-492e-99e6-8b264822012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:19.968644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f756c36a-2623-492e-99e6-8b264822012f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:19.972360 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f756c36a-2623-492e-99e6-8b264822012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:19.987227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-61d6478b-f57c-4afb-9f16-a5bdbfe2fdeb None None] MFA Rules not processed for user `106695be3b344f0bb2072112b0893f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:19.990044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-61d6478b-f57c-4afb-9f16-a5bdbfe2fdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:20.007550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 867/1741] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:20.008441 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756c36a-2623-492e-99e6-8b264822012f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:20.011844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f756c36a-2623-492e-99e6-8b264822012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:20.116498 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 875/1742] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:20.119026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6478b-f57c-4afb-9f16-a5bdbfe2fdeb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:20.141583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6478b-f57c-4afb-9f16-a5bdbfe2fdeb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:20.147574 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ea8b0-6bf9-4d14-bc69-258d29e6fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:20.148472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea8b0-6bf9-4d14-bc69-258d29e6fb17 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:20.148856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea8b0-6bf9-4d14-bc69-258d29e6fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:20.149236 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea8b0-6bf9-4d14-bc69-258d29e6fb17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:20.152272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ea8b0-6bf9-4d14-bc69-258d29e6fb17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:20.154939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ea8b0-6bf9-4d14-bc69-258d29e6fb17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:20.159703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ea8b0-6bf9-4d14-bc69-258d29e6fb17 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:20.183719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 876/1743] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:20.185315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03d3d-8f5d-4f1b-a2a7-b3ec69207238 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:20.186133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03d3d-8f5d-4f1b-a2a7-b3ec69207238 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:20.186466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03d3d-8f5d-4f1b-a2a7-b3ec69207238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:20.237589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756c36a-2623-492e-99e6-8b264822012f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:20.249003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-11c03d3d-8f5d-4f1b-a2a7-b3ec69207238 None None] MFA Rules not processed for user `106695be3b344f0bb2072112b0893f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:20.249953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-11c03d3d-8f5d-4f1b-a2a7-b3ec69207238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:20.255024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f052d53-e89a-4ecb-8406-17ac97a1f689 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccabcc84b874443f9868b0f2553113cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89f22cde3624479ebba8b2cb54c54e8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:20.255779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f052d53-e89a-4ecb-8406-17ac97a1f689 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:20.256134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f052d53-e89a-4ecb-8406-17ac97a1f689 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:20.256479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f052d53-e89a-4ecb-8406-17ac97a1f689 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:20.258018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f052d53-e89a-4ecb-8406-17ac97a1f689 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:20.260553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f052d53-e89a-4ecb-8406-17ac97a1f689 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:20.264105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f052d53-e89a-4ecb-8406-17ac97a1f689 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:20.277941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 877/1744] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:20.278908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03d3d-8f5d-4f1b-a2a7-b3ec69207238 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:20.317551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03d3d-8f5d-4f1b-a2a7-b3ec69207238 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:20.323498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 868/1745] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:20.332163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f052d53-e89a-4ecb-8406-17ac97a1f689 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:20.333983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce89a9-abb8-4987-a9ca-a7827a70a27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:20.335677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce89a9-abb8-4987-a9ca-a7827a70a27f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:20.335677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce89a9-abb8-4987-a9ca-a7827a70a27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:20.335677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce89a9-abb8-4987-a9ca-a7827a70a27f admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:20.335943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce89a9-abb8-4987-a9ca-a7827a70a27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:20.338148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce89a9-abb8-4987-a9ca-a7827a70a27f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:20.381005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f052d53-e89a-4ecb-8406-17ac97a1f689 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:20.392929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeafba-22a6-4710-a3f6-f11bac658811 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccabcc84b874443f9868b0f2553113cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89f22cde3624479ebba8b2cb54c54e8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:20.394032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeafba-22a6-4710-a3f6-f11bac658811 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:20.394528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeafba-22a6-4710-a3f6-f11bac658811 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:20.395009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeafba-22a6-4710-a3f6-f11bac658811 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:20.395846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aeafba-22a6-4710-a3f6-f11bac658811 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:20.400246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aeafba-22a6-4710-a3f6-f11bac658811 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:20.425127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 878/1746] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:20 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:20.428886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce89a9-abb8-4987-a9ca-a7827a70a27f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:20.470975 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 869/1747] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:20 2022] POST /identity/v3/projects => generated 354 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:20.474468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeafba-22a6-4710-a3f6-f11bac658811 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:20.630801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:20.668293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeafba-22a6-4710-a3f6-f11bac658811 tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:20.680164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c335e-7907-416b-bf8a-017b6f771dda tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccabcc84b874443f9868b0f2553113cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89f22cde3624479ebba8b2cb54c54e8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:20.681044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c335e-7907-416b-bf8a-017b6f771dda tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:20.682175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c335e-7907-416b-bf8a-017b6f771dda tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:20.682620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c335e-7907-416b-bf8a-017b6f771dda tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:20.682744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce89a9-abb8-4987-a9ca-a7827a70a27f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:20.683547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c335e-7907-416b-bf8a-017b6f771dda tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:20.684021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c335e-7907-416b-bf8a-017b6f771dda tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:20.686012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c335e-7907-416b-bf8a-017b6f771dda tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:20.702918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 870/1748] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:20.704878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c335e-7907-416b-bf8a-017b6f771dda tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:20.708266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-713c335e-7907-416b-bf8a-017b6f771dda tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:20.745332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:20.824719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae35ca7-4072-42ee-93f5-ec25b822f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:20.826402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae35ca7-4072-42ee-93f5-ec25b822f9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:20.826710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae35ca7-4072-42ee-93f5-ec25b822f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:20.837198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae35ca7-4072-42ee-93f5-ec25b822f9b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:20.837198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae35ca7-4072-42ee-93f5-ec25b822f9b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:20.846438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae35ca7-4072-42ee-93f5-ec25b822f9b7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:20.912428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 879/1749] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:20 2022] POST /identity/v3/users => generated 286 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:20.912428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae35ca7-4072-42ee-93f5-ec25b822f9b7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:20.944101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae35ca7-4072-42ee-93f5-ec25b822f9b7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:20.964590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccabcc84b874443f9868b0f2553113cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89f22cde3624479ebba8b2cb54c54e8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:20.965251 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:20.965538 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:20.966179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] PATH_INFO: `/v3/projects/1f181b3360d942afbba3bf089658090e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:20.967783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c335e-7907-416b-bf8a-017b6f771dda tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:20.974217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1f181b3360d942afbba3bf089658090e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:20.976334 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:20.982606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202df39-0c2b-4726-9400-908e5be9aa36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:20.983248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202df39-0c2b-4726-9400-908e5be9aa36 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:20.986002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202df39-0c2b-4726-9400-908e5be9aa36 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:20.986625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202df39-0c2b-4726-9400-908e5be9aa36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:21.098688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202df39-0c2b-4726-9400-908e5be9aa36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:21.100544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202df39-0c2b-4726-9400-908e5be9aa36 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:21.118474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 871/1750] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:21.130212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202df39-0c2b-4726-9400-908e5be9aa36 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:21.162821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202df39-0c2b-4726-9400-908e5be9aa36 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:21.182990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f181b3360d942afbba3bf089658090e', 'request_id': 'req-395ed1f9-97b4-4584-990b-81aaca7528bd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:21.205034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f181b3360d942afbba3bf089658090e', 'request_id': 'req-395ed1f9-97b4-4584-990b-81aaca7528bd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:21.224929 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f181b3360d942afbba3bf089658090e', 'request_id': 'req-395ed1f9-97b4-4584-990b-81aaca7528bd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:21.297646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] The token cache is being invalidate because project 1f181b3360d942afbba3bf089658090e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:21.298147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:21.303045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:21.315258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 880/1751] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:20 2022] DELETE /identity/v3/projects/1f181b3360d942afbba3bf089658090e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:21.400867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb4cd4-b8a3-4b91-8397-725556bbfe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:21.401424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb4cd4-b8a3-4b91-8397-725556bbfe44 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:21.401735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb4cd4-b8a3-4b91-8397-725556bbfe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:21.402017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb4cd4-b8a3-4b91-8397-725556bbfe44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:21.402677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb4cd4-b8a3-4b91-8397-725556bbfe44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:21.413229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb4cd4-b8a3-4b91-8397-725556bbfe44 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:21.462106 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 872/1752] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:21.466183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:21.468364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:21.526442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ed1f9-97b4-4584-990b-81aaca7528bd tempest-VolumeQuotaClassesTest-1296463170 tempest-VolumeQuotaClassesTest-1296463170-project-admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:21.550908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2c4c0-899a-4e38-92ab-2037ff009228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:21.553318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c4c0-899a-4e38-92ab-2037ff009228 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:21.553648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c4c0-899a-4e38-92ab-2037ff009228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:21.556401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c4c0-899a-4e38-92ab-2037ff009228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:21.560993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2c4c0-899a-4e38-92ab-2037ff009228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:21.570043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2c4c0-899a-4e38-92ab-2037ff009228 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:21.619253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb4cd4-b8a3-4b91-8397-725556bbfe44 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:21.620057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 881/1753] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:21.649441 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb4cd4-b8a3-4b91-8397-725556bbfe44 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:21.665369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49d7fa-c78e-40c8-ae7b-f466c997b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:21.667405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d7fa-c78e-40c8-ae7b-f466c997b3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:21.668743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d7fa-c78e-40c8-ae7b-f466c997b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:21.669054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d7fa-c78e-40c8-ae7b-f466c997b3c9 admin admin] PATH_INFO: `/v3/projects/836951e5905f4388bb635f8312e22db8/users/d4f214b8daa6434b9b5dea71f33366c7/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:21.690325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:21.716992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49d7fa-c78e-40c8-ae7b-f466c997b3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836951e5905f4388bb635f8312e22db8, user_id=d4f214b8daa6434b9b5dea71f33366c7, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:21.736488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49d7fa-c78e-40c8-ae7b-f466c997b3c9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:21.795997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 873/1754] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:21 2022] PUT /identity/v3/projects/836951e5905f4388bb635f8312e22db8/users/d4f214b8daa6434b9b5dea71f33366c7/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:21.811641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ed2c-6142-43a9-8546-0fd8245b74f8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:21.812161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ed2c-6142-43a9-8546-0fd8245b74f8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:21.813847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ed2c-6142-43a9-8546-0fd8245b74f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:21.903411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1000ed2c-6142-43a9-8546-0fd8245b74f8 None None] MFA Rules not processed for user `d4f214b8daa6434b9b5dea71f33366c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:21.908452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1000ed2c-6142-43a9-8546-0fd8245b74f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:21.953101 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78f4b9-5dd6-428c-bd8f-56f062a2633a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:21.953970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78f4b9-5dd6-428c-bd8f-56f062a2633a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:21.954259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78f4b9-5dd6-428c-bd8f-56f062a2633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:22.087381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2d78f4b9-5dd6-428c-bd8f-56f062a2633a None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:22.088770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2d78f4b9-5dd6-428c-bd8f-56f062a2633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:22.189337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 882/1755] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:22.191773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ed2c-6142-43a9-8546-0fd8245b74f8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:22.193601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1000ed2c-6142-43a9-8546-0fd8245b74f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:22.269657 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:22.332406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 874/1756] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:12:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:22.335568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78f4b9-5dd6-428c-bd8f-56f062a2633a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:22.437688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ed2c-6142-43a9-8546-0fd8245b74f8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:22.457209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:22.458012 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:22.458355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:22.458639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] PATH_INFO: `/v3/users/852928671a9f44dba51f72bb4c29073a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:22.460549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852928671a9f44dba51f72bb4c29073a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:22.464866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:22.585483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78f4b9-5dd6-428c-bd8f-56f062a2633a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:22.598728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aea9f-1351-4f0d-b01a-be2139e34e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:22.599448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aea9f-1351-4f0d-b01a-be2139e34e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:22.599758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aea9f-1351-4f0d-b01a-be2139e34e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:22.600048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aea9f-1351-4f0d-b01a-be2139e34e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:22.601460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90aea9f-1351-4f0d-b01a-be2139e34e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:22.610356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90aea9f-1351-4f0d-b01a-be2139e34e5d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:22.665034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852928671a9f44dba51f72bb4c29073a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:22.671617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 875/1757] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:22 2022] POST /identity/v3/projects => generated 373 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:22.674120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aea9f-1351-4f0d-b01a-be2139e34e5d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:22.677327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d90aea9f-1351-4f0d-b01a-be2139e34e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:22.690219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852928671a9f44dba51f72bb4c29073a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:22.690845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852928671a9f44dba51f72bb4c29073a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:22.691643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852928671a9f44dba51f72bb4c29073a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:22.701702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852928671a9f44dba51f72bb4c29073a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:22.785254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:22.788879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 883/1758] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:22 2022] DELETE /identity/v3/users/852928671a9f44dba51f72bb4c29073a => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:22.798021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:22.803176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:23.030428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aea9f-1351-4f0d-b01a-be2139e34e5d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:23.081718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9be7b-3e70-48f7-8734-6875f3c913a6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:23.103518 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbee63-b22b-42d0-b98e-8d7f0352cd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:23.104278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbee63-b22b-42d0-b98e-8d7f0352cd78 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:23.106810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbee63-b22b-42d0-b98e-8d7f0352cd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:23.107460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbee63-b22b-42d0-b98e-8d7f0352cd78 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:23.110258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbee63-b22b-42d0-b98e-8d7f0352cd78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:23.118297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbee63-b22b-42d0-b98e-8d7f0352cd78 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:23.198993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 884/1759] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:22 2022] POST /identity/v3/users => generated 293 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:23.202165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cace5-2e0e-42bb-b488-9c8f3db8f1f2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:23.202783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cace5-2e0e-42bb-b488-9c8f3db8f1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:23.204117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cace5-2e0e-42bb-b488-9c8f3db8f1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:23.241916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c591ca-9d17-4c16-a92e-120f697f7f06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:23.242564 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c591ca-9d17-4c16-a92e-120f697f7f06 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:23.242844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c591ca-9d17-4c16-a92e-120f697f7f06 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:23.245461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c591ca-9d17-4c16-a92e-120f697f7f06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:23.251863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f2c591ca-9d17-4c16-a92e-120f697f7f06 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:23.255149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-443cace5-2e0e-42bb-b488-9c8f3db8f1f2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:23.259278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-443cace5-2e0e-42bb-b488-9c8f3db8f1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:23.305981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 885/1760] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:23.308555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cace5-2e0e-42bb-b488-9c8f3db8f1f2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:23.316873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-443cace5-2e0e-42bb-b488-9c8f3db8f1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:23.359135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cace5-2e0e-42bb-b488-9c8f3db8f1f2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:23.385216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:23.393372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:23.393905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:23.394191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] PATH_INFO: `/v3/projects/114b2e5c6227416fa54bacb3fbfcffda` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:23.400345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c591ca-9d17-4c16-a92e-120f697f7f06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:23.411526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=114b2e5c6227416fa54bacb3fbfcffda)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:23.411730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c591ca-9d17-4c16-a92e-120f697f7f06 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:23.415280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:23.457334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 876/1761] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:12:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:12:23.461751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e21b45-3711-4a90-acb4-b0b4626fd535 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:23.462244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:23.465940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e21b45-3711-4a90-acb4-b0b4626fd535 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:23.466370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e21b45-3711-4a90-acb4-b0b4626fd535 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:23.472658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 877/1762] 10.222.0.50 () {54 vars in 912 bytes} [Mon Sep 19 12:12:23 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:12:23.474981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e21b45-3711-4a90-acb4-b0b4626fd535 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:23.485702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e8e21b45-3711-4a90-acb4-b0b4626fd535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:23.525700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114b2e5c6227416fa54bacb3fbfcffda', 'request_id': 'req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:23.549663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114b2e5c6227416fa54bacb3fbfcffda', 'request_id': 'req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:23.561118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114b2e5c6227416fa54bacb3fbfcffda', 'request_id': 'req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:23.590586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] The token cache is being invalidate because project 114b2e5c6227416fa54bacb3fbfcffda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:23.591522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:23.592451 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:23.596409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 886/1763] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:23 2022] DELETE /identity/v3/projects/114b2e5c6227416fa54bacb3fbfcffda => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:23.597494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:23.599098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:23.763801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef262ef-1fae-45d4-8f6a-38927d3ca3d6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:23.770591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e9e56-e0f8-49cc-9c4b-98921e682a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:23.772340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e9e56-e0f8-49cc-9c4b-98921e682a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:23.773559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e9e56-e0f8-49cc-9c4b-98921e682a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:23.774732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e9e56-e0f8-49cc-9c4b-98921e682a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:23.777447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e9e56-e0f8-49cc-9c4b-98921e682a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:23.780347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e9e56-e0f8-49cc-9c4b-98921e682a5f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:23.813549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e21b45-3711-4a90-acb4-b0b4626fd535 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:23.827078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:23.827800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:23.828076 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:23.828975 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] PATH_INFO: `/v3/users/d49503cae2954f09a6a7531f21520973` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:23.830522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49503cae2954f09a6a7531f21520973)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:23.834581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:23.856371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:23.858028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 887/1764] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:23.861048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e9e56-e0f8-49cc-9c4b-98921e682a5f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:23.866010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-227e9e56-e0f8-49cc-9c4b-98921e682a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:24.014187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49503cae2954f09a6a7531f21520973'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:24.045031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49503cae2954f09a6a7531f21520973'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:24.045848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49503cae2954f09a6a7531f21520973'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:24.046465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49503cae2954f09a6a7531f21520973'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:24.066026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17231d83-7cb0-4873-a81a-c979edba04ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49503cae2954f09a6a7531f21520973'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:24.135491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 878/1765] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:23 2022] DELETE /identity/v3/users/d49503cae2954f09a6a7531f21520973 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:24.137657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9751f9-2488-404c-8e76-c2e431384141 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:24.138096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9751f9-2488-404c-8e76-c2e431384141 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:24.138440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9751f9-2488-404c-8e76-c2e431384141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:24.154272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e9e56-e0f8-49cc-9c4b-98921e682a5f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:24.206599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0c9751f9-2488-404c-8e76-c2e431384141 None None] MFA Rules not processed for user `421b120ee015472bb530542ca9418589`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:24.208132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0c9751f9-2488-404c-8e76-c2e431384141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:24.291074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b474f-9c32-4d0d-9b29-5563f2b848f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:24.292363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b474f-9c32-4d0d-9b29-5563f2b848f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:24.292985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b474f-9c32-4d0d-9b29-5563f2b848f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:24.293372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b474f-9c32-4d0d-9b29-5563f2b848f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:24.295994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b15b474f-9c32-4d0d-9b29-5563f2b848f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:24.328490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:24.409424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 879/1766] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:24.418986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b99ab-2740-4fbb-8375-42aa63ff3e1b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:24.418986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b99ab-2740-4fbb-8375-42aa63ff3e1b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:24.418986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b99ab-2740-4fbb-8375-42aa63ff3e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:24.504773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a18b99ab-2740-4fbb-8375-42aa63ff3e1b None None] MFA Rules not processed for user `4fe0dabaf0ef4fc7b417d378334413c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:24.506067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a18b99ab-2740-4fbb-8375-42aa63ff3e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:24.535056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 880/1767] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:12:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:24.538514 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b99ab-2740-4fbb-8375-42aa63ff3e1b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:24.544913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a18b99ab-2740-4fbb-8375-42aa63ff3e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:24.549575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b474f-9c32-4d0d-9b29-5563f2b848f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:24.562005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b474f-9c32-4d0d-9b29-5563f2b848f7 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:24.595184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 888/1768] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:24.601612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b99ab-2740-4fbb-8375-42aa63ff3e1b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:24.602477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b474f-9c32-4d0d-9b29-5563f2b848f7 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:24.605932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b15b474f-9c32-4d0d-9b29-5563f2b848f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:24.629155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:24.629856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:24.630139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:24.630398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] PATH_INFO: `/v3/users/630849f28255483ebb02d4cc93f1c60c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:24.633320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630849f28255483ebb02d4cc93f1c60c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:24.635209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:24.645591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b474f-9c32-4d0d-9b29-5563f2b848f7 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:24.686570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d458d-b55b-44f8-bcff-f81859a5e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:24.687286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d458d-b55b-44f8-bcff-f81859a5e3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:24.687598 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d458d-b55b-44f8-bcff-f81859a5e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:24.687919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d458d-b55b-44f8-bcff-f81859a5e3d6 admin admin] PATH_INFO: `/v3/projects/340b234afb7c4b8ab6bd28a06a167d8b/users/fe76ea16969e44ecbbabe4467b25b204/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:24.739439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d458d-b55b-44f8-bcff-f81859a5e3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340b234afb7c4b8ab6bd28a06a167d8b, user_id=fe76ea16969e44ecbbabe4467b25b204, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:24.742456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d458d-b55b-44f8-bcff-f81859a5e3d6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:24.799898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 889/1769] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:24 2022] PUT /identity/v3/projects/340b234afb7c4b8ab6bd28a06a167d8b/users/fe76ea16969e44ecbbabe4467b25b204/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:24.803622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9098a-89e2-4c72-b1c0-6546dcf2cf98 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:24.803955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9098a-89e2-4c72-b1c0-6546dcf2cf98 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:24.804244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9098a-89e2-4c72-b1c0-6546dcf2cf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:24.813788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630849f28255483ebb02d4cc93f1c60c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:24.857299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630849f28255483ebb02d4cc93f1c60c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:24.858065 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630849f28255483ebb02d4cc93f1c60c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:24.861650 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630849f28255483ebb02d4cc93f1c60c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:24.888681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630849f28255483ebb02d4cc93f1c60c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:24.890454 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:24.891587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d3a9098a-89e2-4c72-b1c0-6546dcf2cf98 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:24.892886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d3a9098a-89e2-4c72-b1c0-6546dcf2cf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:24.949530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 881/1770] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:24 2022] DELETE /identity/v3/users/630849f28255483ebb02d4cc93f1c60c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:24.959268 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:24.966789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:25.134480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 890/1771] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:25.137872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9098a-89e2-4c72-b1c0-6546dcf2cf98 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:25.146026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d3a9098a-89e2-4c72-b1c0-6546dcf2cf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:25.227560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6914f63-8622-413e-a47f-6bf88c879cc2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:25.239742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7416967-862c-4e07-909c-41f171a6bb80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:25.240355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416967-862c-4e07-909c-41f171a6bb80 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:25.240644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416967-862c-4e07-909c-41f171a6bb80 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:25.240923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416967-862c-4e07-909c-41f171a6bb80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:25.246256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f7416967-862c-4e07-909c-41f171a6bb80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:25.354372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9098a-89e2-4c72-b1c0-6546dcf2cf98 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:25.448566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7416967-862c-4e07-909c-41f171a6bb80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:25.451656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7416967-862c-4e07-909c-41f171a6bb80 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:25.499988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 882/1772] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:25.503273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:25.503735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7416967-862c-4e07-909c-41f171a6bb80 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:25.508552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f7416967-862c-4e07-909c-41f171a6bb80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:25.535410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25068fb8-fb01-4878-b535-79de822d5840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:25.536173 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25068fb8-fb01-4878-b535-79de822d5840 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:25.536462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25068fb8-fb01-4878-b535-79de822d5840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:25.536804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25068fb8-fb01-4878-b535-79de822d5840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:25.540652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-25068fb8-fb01-4878-b535-79de822d5840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:25.571897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25068fb8-fb01-4878-b535-79de822d5840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:25.577787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25068fb8-fb01-4878-b535-79de822d5840 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:25.608303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 891/1773] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:25.614179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312fde6-088c-4fdb-8a13-634029e8f72c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:25.615554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312fde6-088c-4fdb-8a13-634029e8f72c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:25.616051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312fde6-088c-4fdb-8a13-634029e8f72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:25.686499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7416967-862c-4e07-909c-41f171a6bb80 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:25.694769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c31f6-2161-4095-ab75-9048d4aa75c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:25.695404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c31f6-2161-4095-ab75-9048d4aa75c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:25.696091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c31f6-2161-4095-ab75-9048d4aa75c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:25.696091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c31f6-2161-4095-ab75-9048d4aa75c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:25.696892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c31f6-2161-4095-ab75-9048d4aa75c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:25.698644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c31f6-2161-4095-ab75-9048d4aa75c5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:25.722880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8312fde6-088c-4fdb-8a13-634029e8f72c None None] MFA Rules not processed for user `4fe0dabaf0ef4fc7b417d378334413c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:25.724544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8312fde6-088c-4fdb-8a13-634029e8f72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:25.728964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 883/1774] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:25.730469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c31f6-2161-4095-ab75-9048d4aa75c5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:25.736902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-661c31f6-2161-4095-ab75-9048d4aa75c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:25.741131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 892/1775] 10.222.0.86 () {58 vars in 1015 bytes} [Mon Sep 19 12:12:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:25.742292 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312fde6-088c-4fdb-8a13-634029e8f72c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:25.764376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c31f6-2161-4095-ab75-9048d4aa75c5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:25.775963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312fde6-088c-4fdb-8a13-634029e8f72c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:25.780563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a18d7-7fe8-475c-9613-6728fdaa7f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:25.783805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a18d7-7fe8-475c-9613-6728fdaa7f56 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:25.784750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a18d7-7fe8-475c-9613-6728fdaa7f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:25.785845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a18d7-7fe8-475c-9613-6728fdaa7f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:25.791710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02e19d-66d4-43f2-8dd5-9ec9ba59d581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:25.793599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e19d-66d4-43f2-8dd5-9ec9ba59d581 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:25.794223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e19d-66d4-43f2-8dd5-9ec9ba59d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:25.795516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e19d-66d4-43f2-8dd5-9ec9ba59d581 admin admin] PATH_INFO: `/v3/projects/340b234afb7c4b8ab6bd28a06a167d8b/users/fe76ea16969e44ecbbabe4467b25b204/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:25.804215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02e19d-66d4-43f2-8dd5-9ec9ba59d581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340b234afb7c4b8ab6bd28a06a167d8b, user_id=fe76ea16969e44ecbbabe4467b25b204, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:25.811241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02e19d-66d4-43f2-8dd5-9ec9ba59d581 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:25.817357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a18d7-7fe8-475c-9613-6728fdaa7f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:25.822410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a18d7-7fe8-475c-9613-6728fdaa7f56 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:25.838837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:25.848059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 893/1776] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:25 2022] PUT /identity/v3/projects/340b234afb7c4b8ab6bd28a06a167d8b/users/fe76ea16969e44ecbbabe4467b25b204/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:25.851023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 884/1777] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:25.858622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b04fba-7876-41b6-8cf2-4d6b3bca2755 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:25.859308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b04fba-7876-41b6-8cf2-4d6b3bca2755 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:25.859992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b04fba-7876-41b6-8cf2-4d6b3bca2755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:25.914101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-15b04fba-7876-41b6-8cf2-4d6b3bca2755 None None] MFA Rules not processed for user `fe76ea16969e44ecbbabe4467b25b204`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:25.916428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-15b04fba-7876-41b6-8cf2-4d6b3bca2755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:26.105772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a18d7-7fe8-475c-9613-6728fdaa7f56 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:26.107148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f57a18d7-7fe8-475c-9613-6728fdaa7f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:26.139540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a18d7-7fe8-475c-9613-6728fdaa7f56 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:26.191414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 894/1778] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:26.200910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b04fba-7876-41b6-8cf2-4d6b3bca2755 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:26.203056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-15b04fba-7876-41b6-8cf2-4d6b3bca2755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:26.423790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b04fba-7876-41b6-8cf2-4d6b3bca2755 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:26.440733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df4891-b1c9-4b75-81bf-fbc70f7b5a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:26.447267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df4891-b1c9-4b75-81bf-fbc70f7b5a94 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:26.448365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df4891-b1c9-4b75-81bf-fbc70f7b5a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:26.448738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df4891-b1c9-4b75-81bf-fbc70f7b5a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:26.467962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:26.468762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:26.469583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:26.469896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] PATH_INFO: `/v3/projects/2ca9cfd7fe6b4652b5c7cb30ae7e1a8d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:26.482720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca9cfd7fe6b4652b5c7cb30ae7e1a8d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:26.485469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:26.490224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df4891-b1c9-4b75-81bf-fbc70f7b5a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:26.492075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df4891-b1c9-4b75-81bf-fbc70f7b5a94 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:26.532080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 895/1779] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:26.533465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df4891-b1c9-4b75-81bf-fbc70f7b5a94 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:26.591926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca9cfd7fe6b4652b5c7cb30ae7e1a8d', 'request_id': 'req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:26.606334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca9cfd7fe6b4652b5c7cb30ae7e1a8d', 'request_id': 'req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:26.621799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca9cfd7fe6b4652b5c7cb30ae7e1a8d', 'request_id': 'req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:26.648655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] The token cache is being invalidate because project 2ca9cfd7fe6b4652b5c7cb30ae7e1a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:26.648942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:26.649757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:26.651869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 885/1780] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:26 2022] DELETE /identity/v3/projects/2ca9cfd7fe6b4652b5c7cb30ae7e1a8d => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:12:26.656983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:26.675990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:26.764980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df4891-b1c9-4b75-81bf-fbc70f7b5a94 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:26.775230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:26.915902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36091bf7-681a-403f-98d5-5f64cbacab2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:26.916936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36091bf7-681a-403f-98d5-5f64cbacab2b service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:26.917460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36091bf7-681a-403f-98d5-5f64cbacab2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:26.917997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36091bf7-681a-403f-98d5-5f64cbacab2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:26.920898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-36091bf7-681a-403f-98d5-5f64cbacab2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:26.940286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36091bf7-681a-403f-98d5-5f64cbacab2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:26.944602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb8c70-6044-4dfd-aba5-c41d0debf0f7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:26.945570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36091bf7-681a-403f-98d5-5f64cbacab2b service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:26.961841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:26.965206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:26.967150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:26.967439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] PATH_INFO: `/v3/users/ccabcc84b874443f9868b0f2553113cb` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:26.972080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccabcc84b874443f9868b0f2553113cb)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:26.975715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 896/1781] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:26.976903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36091bf7-681a-403f-98d5-5f64cbacab2b service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:26.982627 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:26.983020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-36091bf7-681a-403f-98d5-5f64cbacab2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:27.173921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:27.221760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36091bf7-681a-403f-98d5-5f64cbacab2b service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:27.230712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f4c44-d18b-4415-83a5-0a98e68e4a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:27.231359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f4c44-d18b-4415-83a5-0a98e68e4a14 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:27.231678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f4c44-d18b-4415-83a5-0a98e68e4a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:27.231949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f4c44-d18b-4415-83a5-0a98e68e4a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:27.238336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b15f4c44-d18b-4415-83a5-0a98e68e4a14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:27.247285 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccabcc84b874443f9868b0f2553113cb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:27.271326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccabcc84b874443f9868b0f2553113cb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:27.272325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccabcc84b874443f9868b0f2553113cb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:27.273734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccabcc84b874443f9868b0f2553113cb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:27.295672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccabcc84b874443f9868b0f2553113cb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:27.358247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 886/1782] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:26 2022] DELETE /identity/v3/users/ccabcc84b874443f9868b0f2553113cb => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:27.502408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f4c44-d18b-4415-83a5-0a98e68e4a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:27.503875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f4c44-d18b-4415-83a5-0a98e68e4a14 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:27.535737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 897/1783] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:28.111672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:28.113993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:28.301536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd94c62-213f-4732-bb43-d63bc2dc8f22 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:28.317303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:28.318232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:28.318611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:28.318978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] PATH_INFO: `/v3/projects/0f4997cb257b407da8957e164aa874ff` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:28.322483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4997cb257b407da8957e164aa874ff)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:28.326132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:28.460246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4997cb257b407da8957e164aa874ff', 'request_id': 'req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:28.472035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4997cb257b407da8957e164aa874ff', 'request_id': 'req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:28.488532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4997cb257b407da8957e164aa874ff', 'request_id': 'req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:28.538335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] The token cache is being invalidate because project 0f4997cb257b407da8957e164aa874ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:28.539406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:28.541628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:28.547916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 887/1784] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:28 2022] DELETE /identity/v3/projects/0f4997cb257b407da8957e164aa874ff => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:28.553561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f4c44-d18b-4415-83a5-0a98e68e4a14 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:28.562481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b15f4c44-d18b-4415-83a5-0a98e68e4a14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:28.611977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f4c44-d18b-4415-83a5-0a98e68e4a14 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:28.872844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:28.873655 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:28.885653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:28.885653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] PATH_INFO: `/v3/users/998608c3610b48b385e7412670305b02` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:28.902498 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] RBAC: Authorizing `identity:delete_user(user_id=998608c3610b48b385e7412670305b02)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:28.914957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:28.933146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:29.018946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998608c3610b48b385e7412670305b02'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:29.049882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998608c3610b48b385e7412670305b02'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:29.052109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998608c3610b48b385e7412670305b02'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:29.076744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998608c3610b48b385e7412670305b02'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:29.085554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:29.087566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:29.113800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ec7f6697-e89e-4137-8641-60474539269e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998608c3610b48b385e7412670305b02'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:29.118307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef0e11-dc4e-49b0-b602-7a7901b2eab5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:29.131248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:29.133374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:29.133733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:29.134069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] PATH_INFO: `/v3/projects/b3cdeee2522e4e1d9e352f39114a629f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:29.138134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cdeee2522e4e1d9e352f39114a629f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:29.145158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:29.207101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 898/1785] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:28 2022] DELETE /identity/v3/users/998608c3610b48b385e7412670305b02 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:29.277296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:29.314748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cdeee2522e4e1d9e352f39114a629f', 'request_id': 'req-fca45e47-a15d-4fc5-9995-bf710ef91dc5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:29.336018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cdeee2522e4e1d9e352f39114a629f', 'request_id': 'req-fca45e47-a15d-4fc5-9995-bf710ef91dc5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:29.364424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cdeee2522e4e1d9e352f39114a629f', 'request_id': 'req-fca45e47-a15d-4fc5-9995-bf710ef91dc5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:29.400216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] The token cache is being invalidate because project b3cdeee2522e4e1d9e352f39114a629f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:29.403210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:29.407159 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fca45e47-a15d-4fc5-9995-bf710ef91dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:29.417368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 888/1786] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:29 2022] DELETE /identity/v3/projects/b3cdeee2522e4e1d9e352f39114a629f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:29.417591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd39a0-f0fe-4006-a3f1-52db32d8d58e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:29.418027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd39a0-f0fe-4006-a3f1-52db32d8d58e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:29.418358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd39a0-f0fe-4006-a3f1-52db32d8d58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:29.481651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-80bd39a0-f0fe-4006-a3f1-52db32d8d58e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:29.487691 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-80bd39a0-f0fe-4006-a3f1-52db32d8d58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:29.735891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 899/1787] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:29.737913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb57bb7-0140-4edd-ac61-9a9407494e86 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:29.738514 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb57bb7-0140-4edd-ac61-9a9407494e86 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:29.739018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb57bb7-0140-4edd-ac61-9a9407494e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:29.778196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bdb57bb7-0140-4edd-ac61-9a9407494e86 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:29.780508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bdb57bb7-0140-4edd-ac61-9a9407494e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:29.795173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 889/1788] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:29.799369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd39a0-f0fe-4006-a3f1-52db32d8d58e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:29.810871 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd39a0-f0fe-4006-a3f1-52db32d8d58e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:29.830671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a844a-e46b-4283-a1c0-34adcd0a0284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:29.840225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a844a-e46b-4283-a1c0-34adcd0a0284 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:29.844566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a844a-e46b-4283-a1c0-34adcd0a0284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:29.845101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a844a-e46b-4283-a1c0-34adcd0a0284 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:29.845992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a844a-e46b-4283-a1c0-34adcd0a0284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:29.846472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a844a-e46b-4283-a1c0-34adcd0a0284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:29.850806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a844a-e46b-4283-a1c0-34adcd0a0284 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:29.913458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb57bb7-0140-4edd-ac61-9a9407494e86 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:29.915254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 900/1789] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:29.933964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb57bb7-0140-4edd-ac61-9a9407494e86 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:29.980127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b5726-3fd7-4df4-b15f-d068d1f074de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:29.980768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b5726-3fd7-4df4-b15f-d068d1f074de admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:29.981053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b5726-3fd7-4df4-b15f-d068d1f074de admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:29.981325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b5726-3fd7-4df4-b15f-d068d1f074de admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:29.982056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b5726-3fd7-4df4-b15f-d068d1f074de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:30.003164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b5726-3fd7-4df4-b15f-d068d1f074de admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:30.100148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a844a-e46b-4283-a1c0-34adcd0a0284 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:30.100935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 890/1790] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:29 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:30.123674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a844a-e46b-4283-a1c0-34adcd0a0284 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:30.352655 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecf9aa-cd64-4763-9b23-5d80843dbc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:30.353601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf9aa-cd64-4763-9b23-5d80843dbc88 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:30.355341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf9aa-cd64-4763-9b23-5d80843dbc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:30.355749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf9aa-cd64-4763-9b23-5d80843dbc88 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:30.356594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecf9aa-cd64-4763-9b23-5d80843dbc88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:30.359086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecf9aa-cd64-4763-9b23-5d80843dbc88 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:30.386007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:30.424332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 901/1791] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:30 2022] POST /identity/v3/users => generated 294 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:30.428181 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b5726-3fd7-4df4-b15f-d068d1f074de admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:30.454604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b5726-3fd7-4df4-b15f-d068d1f074de admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:30.478464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccb62c-d6d3-466d-a3a2-d26c966df339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:30.483116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb62c-d6d3-466d-a3a2-d26c966df339 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:30.483661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb62c-d6d3-466d-a3a2-d26c966df339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:30.486932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb62c-d6d3-466d-a3a2-d26c966df339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:30.487847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccb62c-d6d3-466d-a3a2-d26c966df339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:30.497061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccb62c-d6d3-466d-a3a2-d26c966df339 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:30.536396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecf9aa-cd64-4763-9b23-5d80843dbc88 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:30.549711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 891/1792] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:30.556713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecf9aa-cd64-4763-9b23-5d80843dbc88 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:30.568758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9d905-f682-496a-8f05-15f9cde9950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:30.577530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9d905-f682-496a-8f05-15f9cde9950b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:30.579244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9d905-f682-496a-8f05-15f9cde9950b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:30.580224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9d905-f682-496a-8f05-15f9cde9950b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:30.582177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9d905-f682-496a-8f05-15f9cde9950b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:30.589955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9d905-f682-496a-8f05-15f9cde9950b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:30.625343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccb62c-d6d3-466d-a3a2-d26c966df339 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:30.640832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccb62c-d6d3-466d-a3a2-d26c966df339 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:30.643468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 902/1793] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:30.674039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e10cd-6de6-4f44-b274-9c5bff638a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:30.674826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e10cd-6de6-4f44-b274-9c5bff638a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:30.675192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e10cd-6de6-4f44-b274-9c5bff638a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:30.676945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e10cd-6de6-4f44-b274-9c5bff638a6c admin admin] PATH_INFO: `/v3/projects/d696dc081b574a17a3a7a8c415d753c1/users/34f0f3c0245b4263b954f5c7e5f1594e/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:30.764052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e10cd-6de6-4f44-b274-9c5bff638a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d696dc081b574a17a3a7a8c415d753c1, user_id=34f0f3c0245b4263b954f5c7e5f1594e, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:30.776421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e10cd-6de6-4f44-b274-9c5bff638a6c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:30.824653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 892/1794] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:30 2022] PUT /identity/v3/projects/d696dc081b574a17a3a7a8c415d753c1/users/34f0f3c0245b4263b954f5c7e5f1594e/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:30.838851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f90006-2e34-4022-a2fe-a41319b38b2f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:30.839349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f90006-2e34-4022-a2fe-a41319b38b2f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:30.839427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f90006-2e34-4022-a2fe-a41319b38b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:30.947828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d9f90006-2e34-4022-a2fe-a41319b38b2f None None] MFA Rules not processed for user `34f0f3c0245b4263b954f5c7e5f1594e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:30.954429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d9f90006-2e34-4022-a2fe-a41319b38b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:30.972690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e10cd-6de6-4f44-b274-9c5bff638a6c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:30.975163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3f3e10cd-6de6-4f44-b274-9c5bff638a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:31.147886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 903/1795] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:31.150245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f90006-2e34-4022-a2fe-a41319b38b2f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:31.181465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f90006-2e34-4022-a2fe-a41319b38b2f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:31.190951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e10cd-6de6-4f44-b274-9c5bff638a6c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:31.200159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ab5d9-838e-4801-9860-6eae14dcf82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:31.202316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ab5d9-838e-4801-9860-6eae14dcf82f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:31.202316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ab5d9-838e-4801-9860-6eae14dcf82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:31.204543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ab5d9-838e-4801-9860-6eae14dcf82f admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:31.205109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:31.205251 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ab5d9-838e-4801-9860-6eae14dcf82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:31.205947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:31.206227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:31.206498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] PATH_INFO: `/v3/projects/89f22cde3624479ebba8b2cb54c54e8a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:31.210309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f22cde3624479ebba8b2cb54c54e8a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:31.210890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ab5d9-838e-4801-9860-6eae14dcf82f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:31.216512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:31.295879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 904/1796] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:31 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:31.312152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ab5d9-838e-4801-9860-6eae14dcf82f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:31.470250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f22cde3624479ebba8b2cb54c54e8a', 'request_id': 'req-ac873ee5-b906-42b0-bab7-3c130e66d5fd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:31.493048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f22cde3624479ebba8b2cb54c54e8a', 'request_id': 'req-ac873ee5-b906-42b0-bab7-3c130e66d5fd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:31.498008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:31.509488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f22cde3624479ebba8b2cb54c54e8a', 'request_id': 'req-ac873ee5-b906-42b0-bab7-3c130e66d5fd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:31.541018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] The token cache is being invalidate because project 89f22cde3624479ebba8b2cb54c54e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:31.542129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:31.546082 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ac873ee5-b906-42b0-bab7-3c130e66d5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:31.550468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 893/1797] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:30 2022] DELETE /identity/v3/projects/89f22cde3624479ebba8b2cb54c54e8a => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:31.555432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895a03-6058-4770-9732-f8222e404143 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:31.555948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895a03-6058-4770-9732-f8222e404143 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:31.556339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895a03-6058-4770-9732-f8222e404143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:31.605116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7d895a03-6058-4770-9732-f8222e404143 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:31.605599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ab5d9-838e-4801-9860-6eae14dcf82f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:31.614248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7d895a03-6058-4770-9732-f8222e404143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:31.829048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618b112-0217-4537-b70d-a7f2dd7504ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:31.829600 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618b112-0217-4537-b70d-a7f2dd7504ab admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:31.829908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618b112-0217-4537-b70d-a7f2dd7504ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:31.830181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618b112-0217-4537-b70d-a7f2dd7504ab admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:31.830819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618b112-0217-4537-b70d-a7f2dd7504ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:31.832845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618b112-0217-4537-b70d-a7f2dd7504ab admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:31.864590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:31.898252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 894/1798] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:31.910396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0818ef6-3da9-4681-80cf-34e533107e98 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:31.910824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0818ef6-3da9-4681-80cf-34e533107e98 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:31.911209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0818ef6-3da9-4681-80cf-34e533107e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:31.921248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 905/1799] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:31 2022] POST /identity/v3/users => generated 299 bytes in 610 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:31.927073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618b112-0217-4537-b70d-a7f2dd7504ab admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:31.930021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f618b112-0217-4537-b70d-a7f2dd7504ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:31.969870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e0818ef6-3da9-4681-80cf-34e533107e98 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:31.979258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618b112-0217-4537-b70d-a7f2dd7504ab admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:31.984715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e0818ef6-3da9-4681-80cf-34e533107e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:32.004074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871a524-e1fd-42f1-bbe0-24c184b9fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:32.004708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871a524-e1fd-42f1-bbe0-24c184b9fa9a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.004991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871a524-e1fd-42f1-bbe0-24c184b9fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.005269 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871a524-e1fd-42f1-bbe0-24c184b9fa9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.005997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871a524-e1fd-42f1-bbe0-24c184b9fa9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:32.008057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871a524-e1fd-42f1-bbe0-24c184b9fa9a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:32.020713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 895/1800] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:32.021880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0818ef6-3da9-4681-80cf-34e533107e98 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:32.054988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 906/1801] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:12:32.059805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871a524-e1fd-42f1-bbe0-24c184b9fa9a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:32.061891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0818ef6-3da9-4681-80cf-34e533107e98 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:32.085181 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f3782-9380-4740-a7d3-b290e7b7f978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:32.085909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f3782-9380-4740-a7d3-b290e7b7f978 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.086323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f3782-9380-4740-a7d3-b290e7b7f978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.086827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f3782-9380-4740-a7d3-b290e7b7f978 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.088221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f3782-9380-4740-a7d3-b290e7b7f978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:32.088358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f3782-9380-4740-a7d3-b290e7b7f978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:32.090531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f3782-9380-4740-a7d3-b290e7b7f978 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:32.105030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871a524-e1fd-42f1-bbe0-24c184b9fa9a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:32.131715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d45341-32d6-45d5-b946-cb3d7aa0cdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:32.132786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d45341-32d6-45d5-b946-cb3d7aa0cdea admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.133098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d45341-32d6-45d5-b946-cb3d7aa0cdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.133383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d45341-32d6-45d5-b946-cb3d7aa0cdea admin admin] PATH_INFO: `/v3/projects/a4ee5af0ac9b4c5e9e993a6e1c8622ba/users/1e5ed2b38d9f4dd4a7af654e0c5a4062/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.142931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 896/1802] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:32.147786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f3782-9380-4740-a7d3-b290e7b7f978 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:32.181904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f3782-9380-4740-a7d3-b290e7b7f978 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:32.182950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d45341-32d6-45d5-b946-cb3d7aa0cdea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ee5af0ac9b4c5e9e993a6e1c8622ba, user_id=1e5ed2b38d9f4dd4a7af654e0c5a4062, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:32.188229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d45341-32d6-45d5-b946-cb3d7aa0cdea admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:32.207864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccc24f-1fa8-400e-8361-ae0959bf6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:32.208604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccc24f-1fa8-400e-8361-ae0959bf6bad admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.208991 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccc24f-1fa8-400e-8361-ae0959bf6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.209371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccc24f-1fa8-400e-8361-ae0959bf6bad admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.210199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccc24f-1fa8-400e-8361-ae0959bf6bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:32.212575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccc24f-1fa8-400e-8361-ae0959bf6bad admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:32.228953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 907/1803] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:32 2022] PUT /identity/v3/projects/a4ee5af0ac9b4c5e9e993a6e1c8622ba/users/1e5ed2b38d9f4dd4a7af654e0c5a4062/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:12:32.230431 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdf3ed-09d8-4e63-8a83-1bc423c5f126 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.230792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdf3ed-09d8-4e63-8a83-1bc423c5f126 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.231148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdf3ed-09d8-4e63-8a83-1bc423c5f126 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.232603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 908/1804] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:12:32.233448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdf3ed-09d8-4e63-8a83-1bc423c5f126 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:32.280552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 897/1805] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:32 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:32.285189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccc24f-1fa8-400e-8361-ae0959bf6bad admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:32.407358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccc24f-1fa8-400e-8361-ae0959bf6bad admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:32.435631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf3435-7fc1-4494-81bc-d7d909700f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:32.435907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3435-7fc1-4494-81bc-d7d909700f0f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.436220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3435-7fc1-4494-81bc-d7d909700f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.436642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3435-7fc1-4494-81bc-d7d909700f0f admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.452275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf3435-7fc1-4494-81bc-d7d909700f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:32.462496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf3435-7fc1-4494-81bc-d7d909700f0f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:32.492024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdf3ed-09d8-4e63-8a83-1bc423c5f126 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:32.511050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043d72-9ed8-4684-9b4c-d5ef2c4e07b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:32.511689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043d72-9ed8-4684-9b4c-d5ef2c4e07b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.511967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043d72-9ed8-4684-9b4c-d5ef2c4e07b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.512245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043d72-9ed8-4684-9b4c-d5ef2c4e07b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.512900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a043d72-9ed8-4684-9b4c-d5ef2c4e07b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:32.516748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 898/1806] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:32 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:32.518828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a043d72-9ed8-4684-9b4c-d5ef2c4e07b6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:32.520294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e0021-0ee9-47b9-ac51-d3cc1919e003 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.521552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e0021-0ee9-47b9-ac51-d3cc1919e003 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.521931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e0021-0ee9-47b9-ac51-d3cc1919e003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.561287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 909/1807] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:32.562424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043d72-9ed8-4684-9b4c-d5ef2c4e07b6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:32.576591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-208e0021-0ee9-47b9-ac51-d3cc1919e003 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:32.579899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-208e0021-0ee9-47b9-ac51-d3cc1919e003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:32.584005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043d72-9ed8-4684-9b4c-d5ef2c4e07b6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:32.603685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2726e-aac9-45d3-9c4c-ae8394d742bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:32.604340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2726e-aac9-45d3-9c4c-ae8394d742bf admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.604874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2726e-aac9-45d3-9c4c-ae8394d742bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.605153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2726e-aac9-45d3-9c4c-ae8394d742bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.605870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2726e-aac9-45d3-9c4c-ae8394d742bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:32.607634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2726e-aac9-45d3-9c4c-ae8394d742bf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:32.630930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 910/1808] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:32.634388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2726e-aac9-45d3-9c4c-ae8394d742bf admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:32.660243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2726e-aac9-45d3-9c4c-ae8394d742bf admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:32.670187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009f9b9-d7a5-40c2-a4e8-481383d4ef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:32.670868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009f9b9-d7a5-40c2-a4e8-481383d4ef35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.671235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009f9b9-d7a5-40c2-a4e8-481383d4ef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.671534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009f9b9-d7a5-40c2-a4e8-481383d4ef35 admin admin] PATH_INFO: `/v3/projects/a4ee5af0ac9b4c5e9e993a6e1c8622ba/users/1e5ed2b38d9f4dd4a7af654e0c5a4062/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.675007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009f9b9-d7a5-40c2-a4e8-481383d4ef35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ee5af0ac9b4c5e9e993a6e1c8622ba, user_id=1e5ed2b38d9f4dd4a7af654e0c5a4062, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:32.677797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009f9b9-d7a5-40c2-a4e8-481383d4ef35 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:32.690398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:32.708087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 911/1809] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:32 2022] PUT /identity/v3/projects/a4ee5af0ac9b4c5e9e993a6e1c8622ba/users/1e5ed2b38d9f4dd4a7af654e0c5a4062/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:32.725551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009f9b9-d7a5-40c2-a4e8-481383d4ef35 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:32.810571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 899/1810] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:12:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:32.815894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da9ec4-e086-4489-9290-8a5538933a3e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.816187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da9ec4-e086-4489-9290-8a5538933a3e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.816527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da9ec4-e086-4489-9290-8a5538933a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.871750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009f9b9-d7a5-40c2-a4e8-481383d4ef35 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:32.874141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-41da9ec4-e086-4489-9290-8a5538933a3e None None] MFA Rules not processed for user `1e5ed2b38d9f4dd4a7af654e0c5a4062`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:32.877020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-41da9ec4-e086-4489-9290-8a5538933a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:32.883344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3fee5-947f-408d-be46-39276412a997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:32.883950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3fee5-947f-408d-be46-39276412a997 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.884233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3fee5-947f-408d-be46-39276412a997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.884559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3fee5-947f-408d-be46-39276412a997 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:32.885157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3fee5-947f-408d-be46-39276412a997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:32.886903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3fee5-947f-408d-be46-39276412a997 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:32.923906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 912/1811] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:32.930657 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3fee5-947f-408d-be46-39276412a997 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:32.972076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3fee5-947f-408d-be46-39276412a997 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:32.989371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31c04d-4604-4979-b754-be8a62133f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:32.990396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c04d-4604-4979-b754-be8a62133f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:32.990396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c04d-4604-4979-b754-be8a62133f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:32.990645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c04d-4604-4979-b754-be8a62133f42 admin admin] PATH_INFO: `/v3/projects/a163aa94c9704dcd8f8e30386fcfc92c/users/b34f875916c9419ea92c38ab5d6ffa70/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:33.007373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 900/1812] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:33.020116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da9ec4-e086-4489-9290-8a5538933a3e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:33.023256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-41da9ec4-e086-4489-9290-8a5538933a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:33.052863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31c04d-4604-4979-b754-be8a62133f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a163aa94c9704dcd8f8e30386fcfc92c, user_id=b34f875916c9419ea92c38ab5d6ffa70, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:33.061950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31c04d-4604-4979-b754-be8a62133f42 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:33.117683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 913/1813] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:32 2022] PUT /identity/v3/projects/a163aa94c9704dcd8f8e30386fcfc92c/users/b34f875916c9419ea92c38ab5d6ffa70/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:33.128229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e478f-ae0e-4a07-91fb-ba2cbcc0bcd3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:33.128569 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e478f-ae0e-4a07-91fb-ba2cbcc0bcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:33.128778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e478f-ae0e-4a07-91fb-ba2cbcc0bcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:33.151902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:33.214944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da9ec4-e086-4489-9290-8a5538933a3e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:33.249120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d30e478f-ae0e-4a07-91fb-ba2cbcc0bcd3 None None] MFA Rules not processed for user `b34f875916c9419ea92c38ab5d6ffa70`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:33.255685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d30e478f-ae0e-4a07-91fb-ba2cbcc0bcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:33.356188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24e74-7d9f-4623-894f-800887f2e49c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:33.356872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24e74-7d9f-4623-894f-800887f2e49c service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:33.357195 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24e74-7d9f-4623-894f-800887f2e49c service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:33.357473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24e74-7d9f-4623-894f-800887f2e49c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:33.416645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:33.518103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca24e74-7d9f-4623-894f-800887f2e49c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:33.520263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca24e74-7d9f-4623-894f-800887f2e49c service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:33.533824 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 914/1814] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:33.534980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e478f-ae0e-4a07-91fb-ba2cbcc0bcd3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:33.541769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d30e478f-ae0e-4a07-91fb-ba2cbcc0bcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:33.544162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 901/1815] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:33.545267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24e74-7d9f-4623-894f-800887f2e49c service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:33.717022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24e74-7d9f-4623-894f-800887f2e49c service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:33.727766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f5df-521c-4200-a331-7f7759dc9534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:33.728373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f5df-521c-4200-a331-7f7759dc9534 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:33.728751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f5df-521c-4200-a331-7f7759dc9534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:33.729123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f5df-521c-4200-a331-7f7759dc9534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:33.730239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0f5df-521c-4200-a331-7f7759dc9534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:33.732418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0f5df-521c-4200-a331-7f7759dc9534 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:33.797824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 902/1816] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:33 2022] POST /identity/v3/projects => generated 383 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:33.797824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f5df-521c-4200-a331-7f7759dc9534 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:33.877603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e478f-ae0e-4a07-91fb-ba2cbcc0bcd3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:33.986284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f5df-521c-4200-a331-7f7759dc9534 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:34.002781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:34.003876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:34.003876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:34.004790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] PATH_INFO: `/v3/users/34f0f3c0245b4263b954f5c7e5f1594e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:34.012373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f0f3c0245b4263b954f5c7e5f1594e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:34.015891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:34.131916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f0f3c0245b4263b954f5c7e5f1594e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:34.133782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:34.146156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f0f3c0245b4263b954f5c7e5f1594e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:34.146900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f0f3c0245b4263b954f5c7e5f1594e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:34.147735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f0f3c0245b4263b954f5c7e5f1594e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:34.173534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f0f3c0245b4263b954f5c7e5f1594e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:34.189794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53675a6-1f11-4e90-babe-7ab915fe9e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:34.192327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53675a6-1f11-4e90-babe-7ab915fe9e6c service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:34.192651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53675a6-1f11-4e90-babe-7ab915fe9e6c service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:34.193009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53675a6-1f11-4e90-babe-7ab915fe9e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:34.207911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e53675a6-1f11-4e90-babe-7ab915fe9e6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:34.230741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53675a6-1f11-4e90-babe-7ab915fe9e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:34.237937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53675a6-1f11-4e90-babe-7ab915fe9e6c service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:34.242416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 903/1817] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:33 2022] DELETE /identity/v3/users/34f0f3c0245b4263b954f5c7e5f1594e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:34.247764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:34.252003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:34.267519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 915/1818] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:34.268493 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53675a6-1f11-4e90-babe-7ab915fe9e6c service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:34.274594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e53675a6-1f11-4e90-babe-7ab915fe9e6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:34.309466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53675a6-1f11-4e90-babe-7ab915fe9e6c service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:34.345026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:34.467969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fc95f-ed13-4cb9-9278-fe7beed6c6cc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:34.504620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33debf47-1b28-4e54-9df9-656aff884c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:34.504620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33debf47-1b28-4e54-9df9-656aff884c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:34.504620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33debf47-1b28-4e54-9df9-656aff884c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:34.504959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33debf47-1b28-4e54-9df9-656aff884c5b admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:34.505603 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33debf47-1b28-4e54-9df9-656aff884c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:34.517783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:34.518422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:34.522927 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33debf47-1b28-4e54-9df9-656aff884c5b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:34.526388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:34.526388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] PATH_INFO: `/v3/projects/8dd10840c2224ff29996dc86c617699b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:34.531757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd10840c2224ff29996dc86c617699b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:34.533943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:34.605831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 904/1819] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:34 2022] POST /identity/v3/users => generated 298 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:34.607509 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d479-99e2-48bc-a0f9-53ec9528ab54 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:34.611910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d479-99e2-48bc-a0f9-53ec9528ab54 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:34.612217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d479-99e2-48bc-a0f9-53ec9528ab54 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:34.617961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 905/1820] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:12:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:12:34.619137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925d1ee-daac-440b-9f10-eb2d85da38b5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:34.619422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925d1ee-daac-440b-9f10-eb2d85da38b5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:34.619697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925d1ee-daac-440b-9f10-eb2d85da38b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:34.693277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd10840c2224ff29996dc86c617699b', 'request_id': 'req-cc416916-c148-4e25-ab53-1af62df63e59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:34.699210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4925d1ee-daac-440b-9f10-eb2d85da38b5 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:34.700353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4925d1ee-daac-440b-9f10-eb2d85da38b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:34.721271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd10840c2224ff29996dc86c617699b', 'request_id': 'req-cc416916-c148-4e25-ab53-1af62df63e59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:34.749801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd10840c2224ff29996dc86c617699b', 'request_id': 'req-cc416916-c148-4e25-ab53-1af62df63e59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:34.798896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] The token cache is being invalidate because project 8dd10840c2224ff29996dc86c617699b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:34.799323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:34.809237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:34.813446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 916/1821] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:34 2022] DELETE /identity/v3/projects/8dd10840c2224ff29996dc86c617699b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:34.815996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:34.826199 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:34.923670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 906/1822] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:34.925277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34230e22-b1e3-491c-87f2-038d0039c397 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:34.925566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34230e22-b1e3-491c-87f2-038d0039c397 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:34.927783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34230e22-b1e3-491c-87f2-038d0039c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:35.012608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-34230e22-b1e3-491c-87f2-038d0039c397 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:35.016042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-34230e22-b1e3-491c-87f2-038d0039c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:35.049867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 907/1823] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:35.052578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414cd7c-d41d-46ae-ac1f-ec7bd3bb0544 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:35.054790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414cd7c-d41d-46ae-ac1f-ec7bd3bb0544 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:35.056862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414cd7c-d41d-46ae-ac1f-ec7bd3bb0544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:35.119152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2414cd7c-d41d-46ae-ac1f-ec7bd3bb0544 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:35.120601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2414cd7c-d41d-46ae-ac1f-ec7bd3bb0544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:35.167826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc416916-c148-4e25-ab53-1af62df63e59 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:35.190976 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeed01-7805-49a9-9f93-67cbfd4af6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:35.191650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeed01-7805-49a9-9f93-67cbfd4af6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:35.191928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeed01-7805-49a9-9f93-67cbfd4af6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:35.192200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeed01-7805-49a9-9f93-67cbfd4af6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:35.193170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeed01-7805-49a9-9f93-67cbfd4af6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:35.195016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeed01-7805-49a9-9f93-67cbfd4af6e0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:35.247136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 917/1824] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:35.255985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927f40e-0105-4418-a9cb-0066ceea9f2d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:35.256284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927f40e-0105-4418-a9cb-0066ceea9f2d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:35.256568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927f40e-0105-4418-a9cb-0066ceea9f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:35.303499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:35.355764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d927f40e-0105-4418-a9cb-0066ceea9f2d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:35.356595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d927f40e-0105-4418-a9cb-0066ceea9f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:35.368238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 908/1825] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:12:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:35.369238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414cd7c-d41d-46ae-ac1f-ec7bd3bb0544 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:35.374792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2414cd7c-d41d-46ae-ac1f-ec7bd3bb0544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:35.389512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 918/1826] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:35.389909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927f40e-0105-4418-a9cb-0066ceea9f2d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:35.439312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927f40e-0105-4418-a9cb-0066ceea9f2d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:35.455926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6430f-a679-4832-a63d-ce0131c26401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:35.456622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6430f-a679-4832-a63d-ce0131c26401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:35.456916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6430f-a679-4832-a63d-ce0131c26401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:35.457184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6430f-a679-4832-a63d-ce0131c26401 admin admin] PATH_INFO: `/v3/projects/f54f420b5dea4b369b82ccb30cc290d3/users/2ad2e9a556014172862565f12d99873b/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:35.532874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6430f-a679-4832-a63d-ce0131c26401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54f420b5dea4b369b82ccb30cc290d3, user_id=2ad2e9a556014172862565f12d99873b, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:35.535799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6430f-a679-4832-a63d-ce0131c26401 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:35.537252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414cd7c-d41d-46ae-ac1f-ec7bd3bb0544 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:35.547357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac3dc2-8604-4e4d-818d-fcac2e9456c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:35.548761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac3dc2-8604-4e4d-818d-fcac2e9456c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:35.549047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac3dc2-8604-4e4d-818d-fcac2e9456c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:35.549333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac3dc2-8604-4e4d-818d-fcac2e9456c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:35.578184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac3dc2-8604-4e4d-818d-fcac2e9456c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:35.578657 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 919/1827] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:35 2022] PUT /identity/v3/projects/f54f420b5dea4b369b82ccb30cc290d3/users/2ad2e9a556014172862565f12d99873b/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:35.582098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac3dc2-8604-4e4d-818d-fcac2e9456c1 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:35.582884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6430f-a679-4832-a63d-ce0131c26401 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:35.603953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:35.613525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 909/1828] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:35.615338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac3dc2-8604-4e4d-818d-fcac2e9456c1 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:35.647657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac3dc2-8604-4e4d-818d-fcac2e9456c1 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:35.837496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6430f-a679-4832-a63d-ce0131c26401 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:35.865263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f56583-5855-4478-8146-f9ca93dc6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:35.866743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f56583-5855-4478-8146-f9ca93dc6c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:35.868492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f56583-5855-4478-8146-f9ca93dc6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:35.871802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f56583-5855-4478-8146-f9ca93dc6c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:35.873867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58500b91-5ac2-4221-878a-c4edeeb9348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:35.874576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58500b91-5ac2-4221-878a-c4edeeb9348d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:35.874908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58500b91-5ac2-4221-878a-c4edeeb9348d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:35.875640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58500b91-5ac2-4221-878a-c4edeeb9348d admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:35.876369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58500b91-5ac2-4221-878a-c4edeeb9348d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:35.878238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58500b91-5ac2-4221-878a-c4edeeb9348d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:35.880058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f56583-5855-4478-8146-f9ca93dc6c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:35.880603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f56583-5855-4478-8146-f9ca93dc6c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:35.887849 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f56583-5855-4478-8146-f9ca93dc6c89 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:35.899956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 910/1829] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:35.901651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58500b91-5ac2-4221-878a-c4edeeb9348d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:35.935217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58500b91-5ac2-4221-878a-c4edeeb9348d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:35.941533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 920/1830] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:35.944917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f56583-5855-4478-8146-f9ca93dc6c89 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:35.950587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974497b-febd-45f0-9f59-03bedc1d1900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:35.952427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974497b-febd-45f0-9f59-03bedc1d1900 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:35.952730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974497b-febd-45f0-9f59-03bedc1d1900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:35.954532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974497b-febd-45f0-9f59-03bedc1d1900 admin admin] PATH_INFO: `/v3/projects/f54f420b5dea4b369b82ccb30cc290d3/users/2ad2e9a556014172862565f12d99873b/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:35.962344 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974497b-febd-45f0-9f59-03bedc1d1900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54f420b5dea4b369b82ccb30cc290d3, user_id=2ad2e9a556014172862565f12d99873b, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:35.968681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974497b-febd-45f0-9f59-03bedc1d1900 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:35.972392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f56583-5855-4478-8146-f9ca93dc6c89 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:35.983817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1c458-db09-499f-9770-2266e843b8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:35.988552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c458-db09-499f-9770-2266e843b8de admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:35.990195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c458-db09-499f-9770-2266e843b8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:35.990671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c458-db09-499f-9770-2266e843b8de admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:35.993277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1c458-db09-499f-9770-2266e843b8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:35.996268 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 911/1831] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:35 2022] PUT /identity/v3/projects/f54f420b5dea4b369b82ccb30cc290d3/users/2ad2e9a556014172862565f12d99873b/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:36.009525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d17ed-4c3e-4a13-a311-0fdfcc968cd4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:36.009871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d17ed-4c3e-4a13-a311-0fdfcc968cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:36.010276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d17ed-4c3e-4a13-a311-0fdfcc968cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:36.011672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1c458-db09-499f-9770-2266e843b8de admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:36.120788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-be6d17ed-4c3e-4a13-a311-0fdfcc968cd4 None None] MFA Rules not processed for user `2ad2e9a556014172862565f12d99873b`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:36.128430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-be6d17ed-4c3e-4a13-a311-0fdfcc968cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:36.131332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 921/1832] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:35 2022] POST /identity/v3/projects => generated 363 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:36.133506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1c458-db09-499f-9770-2266e843b8de admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:36.137752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4db1c458-db09-499f-9770-2266e843b8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:36.303695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:36.382625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 912/1833] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:36.384640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d17ed-4c3e-4a13-a311-0fdfcc968cd4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:36.439890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1c458-db09-499f-9770-2266e843b8de admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:36.466358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32353886-cf9b-40e7-8689-09d8da020f28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:36.467954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353886-cf9b-40e7-8689-09d8da020f28 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:36.468353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353886-cf9b-40e7-8689-09d8da020f28 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:36.469990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353886-cf9b-40e7-8689-09d8da020f28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:36.499796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32353886-cf9b-40e7-8689-09d8da020f28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:36.505870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32353886-cf9b-40e7-8689-09d8da020f28 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:36.567066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 922/1834] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:36.567066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32353886-cf9b-40e7-8689-09d8da020f28 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:36.567066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-32353886-cf9b-40e7-8689-09d8da020f28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:36.614832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d17ed-4c3e-4a13-a311-0fdfcc968cd4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:36.650579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889490b4-0157-44e4-9de8-8ae2a3f67338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:36.651091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889490b4-0157-44e4-9de8-8ae2a3f67338 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:36.651420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889490b4-0157-44e4-9de8-8ae2a3f67338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:36.651721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889490b4-0157-44e4-9de8-8ae2a3f67338 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:36.652403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889490b4-0157-44e4-9de8-8ae2a3f67338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:36.654394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889490b4-0157-44e4-9de8-8ae2a3f67338 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:36.727230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 913/1835] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:36 2022] POST /identity/v3/users => generated 282 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:36.731109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889490b4-0157-44e4-9de8-8ae2a3f67338 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:36.764599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889490b4-0157-44e4-9de8-8ae2a3f67338 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:36.775346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5804aff-8305-4f1d-8ce4-db49e9d2cbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:36.776020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5804aff-8305-4f1d-8ce4-db49e9d2cbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:36.776309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5804aff-8305-4f1d-8ce4-db49e9d2cbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:36.776626 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5804aff-8305-4f1d-8ce4-db49e9d2cbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:36.777686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5804aff-8305-4f1d-8ce4-db49e9d2cbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:36.778554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32353886-cf9b-40e7-8689-09d8da020f28 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:36.782463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5804aff-8305-4f1d-8ce4-db49e9d2cbd4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:36.791467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf120f-d9a5-4ebd-af04-13df868cb2e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:36.792179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf120f-d9a5-4ebd-af04-13df868cb2e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:36.794892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf120f-d9a5-4ebd-af04-13df868cb2e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:36.794892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf120f-d9a5-4ebd-af04-13df868cb2e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:36.804905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 914/1836] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:12:36.808938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5804aff-8305-4f1d-8ce4-db49e9d2cbd4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:36.819966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf120f-d9a5-4ebd-af04-13df868cb2e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:36.821838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf120f-d9a5-4ebd-af04-13df868cb2e7 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:36.846723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5804aff-8305-4f1d-8ce4-db49e9d2cbd4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:36.859227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 923/1837] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:36.879438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8712ae5-c5d7-43b6-950c-b069f87417a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:36.880072 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8712ae5-c5d7-43b6-950c-b069f87417a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:36.880349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8712ae5-c5d7-43b6-950c-b069f87417a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:36.881795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8712ae5-c5d7-43b6-950c-b069f87417a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:36.882456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8712ae5-c5d7-43b6-950c-b069f87417a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:36.886385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8712ae5-c5d7-43b6-950c-b069f87417a8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:36.921608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 915/1838] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:12:36.925457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf120f-d9a5-4ebd-af04-13df868cb2e7 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:36.947884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf120f-d9a5-4ebd-af04-13df868cb2e7 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:36.962137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90db14c-3592-440b-a1e6-8aa6157a0853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:36.962853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90db14c-3592-440b-a1e6-8aa6157a0853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:36.966863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90db14c-3592-440b-a1e6-8aa6157a0853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:36.967158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90db14c-3592-440b-a1e6-8aa6157a0853 admin admin] PATH_INFO: `/v3/projects/bdb9dff4e7d24593847413a8ef6e998a/users/a93ba7857bc64a91a449d25f501207dd/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:37.039945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:37.072795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90db14c-3592-440b-a1e6-8aa6157a0853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb9dff4e7d24593847413a8ef6e998a, user_id=a93ba7857bc64a91a449d25f501207dd, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:37.080406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90db14c-3592-440b-a1e6-8aa6157a0853 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:37.154512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7bf3f-49ae-4b32-9872-dd02dd0c81ef None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:37.155181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 924/1839] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:36 2022] PUT /identity/v3/projects/bdb9dff4e7d24593847413a8ef6e998a/users/a93ba7857bc64a91a449d25f501207dd/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:37.155267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7bf3f-49ae-4b32-9872-dd02dd0c81ef None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:37.155267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7bf3f-49ae-4b32-9872-dd02dd0c81ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:37.172814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90db14c-3592-440b-a1e6-8aa6157a0853 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:37.176819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b90db14c-3592-440b-a1e6-8aa6157a0853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:37.270526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8ba7bf3f-49ae-4b32-9872-dd02dd0c81ef None None] MFA Rules not processed for user `a93ba7857bc64a91a449d25f501207dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:37.274519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ba7bf3f-49ae-4b32-9872-dd02dd0c81ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:37.345582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90db14c-3592-440b-a1e6-8aa6157a0853 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:37.368777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde28ca5-1fbe-40f4-b0a7-9ff069679356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:37.369523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde28ca5-1fbe-40f4-b0a7-9ff069679356 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:37.369934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde28ca5-1fbe-40f4-b0a7-9ff069679356 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:37.370310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde28ca5-1fbe-40f4-b0a7-9ff069679356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:37.390667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fde28ca5-1fbe-40f4-b0a7-9ff069679356 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:37.508519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 916/1840] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:37.513395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7bf3f-49ae-4b32-9872-dd02dd0c81ef None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:37.565101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde28ca5-1fbe-40f4-b0a7-9ff069679356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:37.567273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde28ca5-1fbe-40f4-b0a7-9ff069679356 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:37.607004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 925/1841] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:37.681341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:37.713860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7bf3f-49ae-4b32-9872-dd02dd0c81ef None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:37.758097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9635e71-7dfe-445e-8049-de3708f7f4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:37.758992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9635e71-7dfe-445e-8049-de3708f7f4ec admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:37.760556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9635e71-7dfe-445e-8049-de3708f7f4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:37.762594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9635e71-7dfe-445e-8049-de3708f7f4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:37.764262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9635e71-7dfe-445e-8049-de3708f7f4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:37.775326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9635e71-7dfe-445e-8049-de3708f7f4ec admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:37.884579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 917/1842] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:37 2022] POST /identity/v3/projects => generated 365 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:12:37.886554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde28ca5-1fbe-40f4-b0a7-9ff069679356 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:37.900948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde28ca5-1fbe-40f4-b0a7-9ff069679356 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:38.031989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333f546-cbbc-460f-bb69-4fd2f8221acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:38.032787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f546-cbbc-460f-bb69-4fd2f8221acd admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:38.052859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f546-cbbc-460f-bb69-4fd2f8221acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:38.054152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f546-cbbc-460f-bb69-4fd2f8221acd admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:38.056264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333f546-cbbc-460f-bb69-4fd2f8221acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:38.058925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333f546-cbbc-460f-bb69-4fd2f8221acd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:38.097660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 926/1843] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:37 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:38.101115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9635e71-7dfe-445e-8049-de3708f7f4ec admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:38.121830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9635e71-7dfe-445e-8049-de3708f7f4ec admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:38.127476 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc95de-7399-47b8-a1a2-36368f263209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:38.128228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc95de-7399-47b8-a1a2-36368f263209 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:38.128573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc95de-7399-47b8-a1a2-36368f263209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:38.128998 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc95de-7399-47b8-a1a2-36368f263209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:38.129942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc95de-7399-47b8-a1a2-36368f263209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:38.131720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc95de-7399-47b8-a1a2-36368f263209 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:38.155086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 918/1844] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:38.159734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333f546-cbbc-460f-bb69-4fd2f8221acd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:38.171140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc95de-7399-47b8-a1a2-36368f263209 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:38.176775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333f546-cbbc-460f-bb69-4fd2f8221acd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:38.190514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5bd4-48e6-4a58-a03d-b20016a1f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:38.193362 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5bd4-48e6-4a58-a03d-b20016a1f9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:38.193674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5bd4-48e6-4a58-a03d-b20016a1f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:38.194402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5bd4-48e6-4a58-a03d-b20016a1f9ba admin admin] PATH_INFO: `/v3/projects/58a70050354645df88c00f06ee670324/users/0d7233c79e33453a82477289afaec94b/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:38.207774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc95de-7399-47b8-a1a2-36368f263209 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:38.226638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:38.227367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:38.228725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:38.229062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] PATH_INFO: `/v3/users/b34f875916c9419ea92c38ab5d6ffa70` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:38.233934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34f875916c9419ea92c38ab5d6ffa70)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:38.239584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:38.249184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b5bd4-48e6-4a58-a03d-b20016a1f9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a70050354645df88c00f06ee670324, user_id=0d7233c79e33453a82477289afaec94b, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:38.253458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b5bd4-48e6-4a58-a03d-b20016a1f9ba admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:38.290571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 927/1845] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:38 2022] PUT /identity/v3/projects/58a70050354645df88c00f06ee670324/users/0d7233c79e33453a82477289afaec94b/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:12:38.292572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5bd4-48e6-4a58-a03d-b20016a1f9ba admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:38.333326 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:38.353650 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34f875916c9419ea92c38ab5d6ffa70'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:38.380379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34f875916c9419ea92c38ab5d6ffa70'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:38.384051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34f875916c9419ea92c38ab5d6ffa70'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:38.389367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34f875916c9419ea92c38ab5d6ffa70'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:38.432349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b6a0d59-6f19-4523-b04c-7de91f13ab65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34f875916c9419ea92c38ab5d6ffa70'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:38.479505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 919/1846] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:38 2022] DELETE /identity/v3/users/b34f875916c9419ea92c38ab5d6ffa70 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:38.484925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77618f6-fc7f-4eaa-b3a4-045a978a53b7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:38.485205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77618f6-fc7f-4eaa-b3a4-045a978a53b7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:38.485476 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77618f6-fc7f-4eaa-b3a4-045a978a53b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:38.529060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5bd4-48e6-4a58-a03d-b20016a1f9ba admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:38.556077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d77618f6-fc7f-4eaa-b3a4-045a978a53b7 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:38.557215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d77618f6-fc7f-4eaa-b3a4-045a978a53b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:38.703114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc790693-ca92-4db0-a2c1-49058b131387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:38.703749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790693-ca92-4db0-a2c1-49058b131387 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:38.704027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790693-ca92-4db0-a2c1-49058b131387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:38.704301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790693-ca92-4db0-a2c1-49058b131387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:38.704946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc790693-ca92-4db0-a2c1-49058b131387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:38.706702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc790693-ca92-4db0-a2c1-49058b131387 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:38.716258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 920/1847] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:38.727188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 928/1848] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:38.735503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77618f6-fc7f-4eaa-b3a4-045a978a53b7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:38.749263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d77618f6-fc7f-4eaa-b3a4-045a978a53b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:38.752118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76915230-269b-4cc2-a50d-260783888532 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:38.752408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76915230-269b-4cc2-a50d-260783888532 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:38.752689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76915230-269b-4cc2-a50d-260783888532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:38.771707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77618f6-fc7f-4eaa-b3a4-045a978a53b7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:38.783032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe463f-cdab-4d94-aa3a-e581ef4973a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:38.784436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe463f-cdab-4d94-aa3a-e581ef4973a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:38.784721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe463f-cdab-4d94-aa3a-e581ef4973a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:38.786671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe463f-cdab-4d94-aa3a-e581ef4973a8 admin admin] PATH_INFO: `/v3/projects/58a70050354645df88c00f06ee670324/users/0d7233c79e33453a82477289afaec94b/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:38.789522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-76915230-269b-4cc2-a50d-260783888532 None None] MFA Rules not processed for user `421b120ee015472bb530542ca9418589`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:38.789686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe463f-cdab-4d94-aa3a-e581ef4973a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a70050354645df88c00f06ee670324, user_id=0d7233c79e33453a82477289afaec94b, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:38.794550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-76915230-269b-4cc2-a50d-260783888532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:38.806753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe463f-cdab-4d94-aa3a-e581ef4973a8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:38.827171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 921/1849] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:38 2022] PUT /identity/v3/projects/58a70050354645df88c00f06ee670324/users/0d7233c79e33453a82477289afaec94b/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:38.828215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe463f-cdab-4d94-aa3a-e581ef4973a8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:38.830122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2bbe463f-cdab-4d94-aa3a-e581ef4973a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:38.881095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:38.896911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 929/1850] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:38.898790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872460d4-7df0-4d7f-b13f-19bbfdf3858a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:38.899762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872460d4-7df0-4d7f-b13f-19bbfdf3858a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:38.900367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872460d4-7df0-4d7f-b13f-19bbfdf3858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:38.955111 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-872460d4-7df0-4d7f-b13f-19bbfdf3858a None None] MFA Rules not processed for user `0d7233c79e33453a82477289afaec94b`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:38.956316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-872460d4-7df0-4d7f-b13f-19bbfdf3858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:38.998449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe463f-cdab-4d94-aa3a-e581ef4973a8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:39.003762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752665e-70e0-44a1-ad09-76aa17736d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:39.004515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752665e-70e0-44a1-ad09-76aa17736d1c service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:39.005017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752665e-70e0-44a1-ad09-76aa17736d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:39.005540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752665e-70e0-44a1-ad09-76aa17736d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:39.037548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:39.076574 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 930/1851] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:39.077602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872460d4-7df0-4d7f-b13f-19bbfdf3858a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:39.079793 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-872460d4-7df0-4d7f-b13f-19bbfdf3858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:39.110133 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752665e-70e0-44a1-ad09-76aa17736d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:39.111633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752665e-70e0-44a1-ad09-76aa17736d1c service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:39.122739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 922/1852] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:39.123665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752665e-70e0-44a1-ad09-76aa17736d1c service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:39.125760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0752665e-70e0-44a1-ad09-76aa17736d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:39.188691 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872460d4-7df0-4d7f-b13f-19bbfdf3858a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:39.206164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:39.207181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:39.209219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:39.210236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752665e-70e0-44a1-ad09-76aa17736d1c service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:39.210882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] PATH_INFO: `/v3/projects/d696dc081b574a17a3a7a8c415d753c1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:39.214551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d696dc081b574a17a3a7a8c415d753c1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:39.215636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d28e8-2beb-4f5d-9b19-f9a5cebc6922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:39.216338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d28e8-2beb-4f5d-9b19-f9a5cebc6922 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:39.216618 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d28e8-2beb-4f5d-9b19-f9a5cebc6922 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:39.216917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d28e8-2beb-4f5d-9b19-f9a5cebc6922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:39.220315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:39.236906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d28e8-2beb-4f5d-9b19-f9a5cebc6922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:39.239802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d28e8-2beb-4f5d-9b19-f9a5cebc6922 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:39.282515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 923/1853] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:39.351862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd696dc081b574a17a3a7a8c415d753c1', 'request_id': 'req-8770a13e-622c-4b77-9a51-2446825a84d9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:39.387705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd696dc081b574a17a3a7a8c415d753c1', 'request_id': 'req-8770a13e-622c-4b77-9a51-2446825a84d9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:39.395335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd696dc081b574a17a3a7a8c415d753c1', 'request_id': 'req-8770a13e-622c-4b77-9a51-2446825a84d9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:39.395628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d28e8-2beb-4f5d-9b19-f9a5cebc6922 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:39.410792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d28e8-2beb-4f5d-9b19-f9a5cebc6922 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:39.430369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] The token cache is being invalidate because project d696dc081b574a17a3a7a8c415d753c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:39.430753 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:39.432501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:39.438610 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 931/1854] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:39 2022] DELETE /identity/v3/projects/d696dc081b574a17a3a7a8c415d753c1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:39.439937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:39.443204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:39.475724 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea45962-70a8-4d2f-bf39-775fbe17187b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:39.476348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea45962-70a8-4d2f-bf39-775fbe17187b service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:39.476638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea45962-70a8-4d2f-bf39-775fbe17187b service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:39.477525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea45962-70a8-4d2f-bf39-775fbe17187b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:39.480005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7ea45962-70a8-4d2f-bf39-775fbe17187b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:39.529373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:39.549423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770a13e-622c-4b77-9a51-2446825a84d9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:39.558406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:39.559299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:39.559763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:39.560269 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] PATH_INFO: `/v3/users/1e5ed2b38d9f4dd4a7af654e0c5a4062` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:39.561645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5ed2b38d9f4dd4a7af654e0c5a4062)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:39.564791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:39.591607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:39.612732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea45962-70a8-4d2f-bf39-775fbe17187b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:39.614369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea45962-70a8-4d2f-bf39-775fbe17187b service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:39.631871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 924/1855] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:12:39.664331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5ed2b38d9f4dd4a7af654e0c5a4062'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:39.677724 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5ed2b38d9f4dd4a7af654e0c5a4062'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:39.678393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5ed2b38d9f4dd4a7af654e0c5a4062'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:39.679314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5ed2b38d9f4dd4a7af654e0c5a4062'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:39.689548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5ed2b38d9f4dd4a7af654e0c5a4062'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:39.728781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 932/1856] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:39 2022] DELETE /identity/v3/users/1e5ed2b38d9f4dd4a7af654e0c5a4062 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:39.745656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea45962-70a8-4d2f-bf39-775fbe17187b service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:39.748618 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7ea45962-70a8-4d2f-bf39-775fbe17187b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:39.782220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea45962-70a8-4d2f-bf39-775fbe17187b service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:39.942651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:39.944665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:39.944960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:39.947405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] PATH_INFO: `/v3/projects/a163aa94c9704dcd8f8e30386fcfc92c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:39.952082 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a163aa94c9704dcd8f8e30386fcfc92c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:39.955233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:40.056976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a163aa94c9704dcd8f8e30386fcfc92c', 'request_id': 'req-1f1336c7-527a-48e1-8ff9-ca8d3e194494'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.065163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a163aa94c9704dcd8f8e30386fcfc92c', 'request_id': 'req-1f1336c7-527a-48e1-8ff9-ca8d3e194494'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.099200 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a163aa94c9704dcd8f8e30386fcfc92c', 'request_id': 'req-1f1336c7-527a-48e1-8ff9-ca8d3e194494'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.119678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] The token cache is being invalidate because project a163aa94c9704dcd8f8e30386fcfc92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:40.120021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.120651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.123262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 925/1857] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:39 2022] DELETE /identity/v3/projects/a163aa94c9704dcd8f8e30386fcfc92c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:40.129270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:40.130878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:40.149295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234b838-395b-4b15-a404-ec3cbbd76c57 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:40.276715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:40.277599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:40.278161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:40.278619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] PATH_INFO: `/v3/users/2ad2e9a556014172862565f12d99873b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:40.280070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad2e9a556014172862565f12d99873b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:40.283487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:40.393069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad2e9a556014172862565f12d99873b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.405904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad2e9a556014172862565f12d99873b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.407668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad2e9a556014172862565f12d99873b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.408494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad2e9a556014172862565f12d99873b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.414668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:40.416210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:40.425946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-09e48640-585d-4032-9e44-a709a099caee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad2e9a556014172862565f12d99873b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.453750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1336c7-527a-48e1-8ff9-ca8d3e194494 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:40.454901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 933/1858] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:40 2022] DELETE /identity/v3/users/2ad2e9a556014172862565f12d99873b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:40.575977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:40.576781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:40.577215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:40.577899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] PATH_INFO: `/v3/projects/a4ee5af0ac9b4c5e9e993a6e1c8622ba` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:40.579740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ee5af0ac9b4c5e9e993a6e1c8622ba)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:40.582575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:40.584904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:40.696087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ee5af0ac9b4c5e9e993a6e1c8622ba', 'request_id': 'req-57b4a01c-0dcc-4bc3-92ae-65671261456d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.704289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ee5af0ac9b4c5e9e993a6e1c8622ba', 'request_id': 'req-57b4a01c-0dcc-4bc3-92ae-65671261456d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.717018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ee5af0ac9b4c5e9e993a6e1c8622ba', 'request_id': 'req-57b4a01c-0dcc-4bc3-92ae-65671261456d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.732958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] The token cache is being invalidate because project a4ee5af0ac9b4c5e9e993a6e1c8622ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:40.733522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.734296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57b4a01c-0dcc-4bc3-92ae-65671261456d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:40.736087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 926/1859] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:40 2022] DELETE /identity/v3/projects/a4ee5af0ac9b4c5e9e993a6e1c8622ba => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:40.740772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24927ab0-51f4-41c0-96cd-438f0421d256 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:40.741205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24927ab0-51f4-41c0-96cd-438f0421d256 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:40.741393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24927ab0-51f4-41c0-96cd-438f0421d256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:40.779508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-24927ab0-51f4-41c0-96cd-438f0421d256 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:40.782018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-24927ab0-51f4-41c0-96cd-438f0421d256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:40.787947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:40.877311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 934/1860] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:40.886025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52696a8-8858-4157-a60e-5a75f0ddc8d6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:40.886568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52696a8-8858-4157-a60e-5a75f0ddc8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:40.886650 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52696a8-8858-4157-a60e-5a75f0ddc8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:40.913085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f52696a8-8858-4157-a60e-5a75f0ddc8d6 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:40.914371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f52696a8-8858-4157-a60e-5a75f0ddc8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:40.925897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 927/1861] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:40.927003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24927ab0-51f4-41c0-96cd-438f0421d256 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:40.938364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24927ab0-51f4-41c0-96cd-438f0421d256 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:40.943729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c47e0-3601-4a3c-ac46-6eb48e11c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:40.944619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c47e0-3601-4a3c-ac46-6eb48e11c1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:40.944905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c47e0-3601-4a3c-ac46-6eb48e11c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:40.945356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c47e0-3601-4a3c-ac46-6eb48e11c1a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:40.946049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c47e0-3601-4a3c-ac46-6eb48e11c1a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:40.946469 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c47e0-3601-4a3c-ac46-6eb48e11c1a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:40.948659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c47e0-3601-4a3c-ac46-6eb48e11c1a0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:40.965665 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 935/1862] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:40.970759 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52696a8-8858-4157-a60e-5a75f0ddc8d6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:40.981601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52696a8-8858-4157-a60e-5a75f0ddc8d6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:40.990871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b4d7c-f9aa-48ad-979d-5b1dd6cd21fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:40.991531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b4d7c-f9aa-48ad-979d-5b1dd6cd21fd admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:40.991899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b4d7c-f9aa-48ad-979d-5b1dd6cd21fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:40.992100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b4d7c-f9aa-48ad-979d-5b1dd6cd21fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:40.992841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b4d7c-f9aa-48ad-979d-5b1dd6cd21fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:40.994968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b4d7c-f9aa-48ad-979d-5b1dd6cd21fd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:41.037762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 928/1863] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:40 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:12:41.039040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c47e0-3601-4a3c-ac46-6eb48e11c1a0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:41.050517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c47e0-3601-4a3c-ac46-6eb48e11c1a0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:41.123601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93a7d3-4b3c-4a4c-90f5-b787ab56bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:41.124232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93a7d3-4b3c-4a4c-90f5-b787ab56bf07 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.124516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93a7d3-4b3c-4a4c-90f5-b787ab56bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.125361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93a7d3-4b3c-4a4c-90f5-b787ab56bf07 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.126592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93a7d3-4b3c-4a4c-90f5-b787ab56bf07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:41.128548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93a7d3-4b3c-4a4c-90f5-b787ab56bf07 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:41.155133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 936/1864] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:41 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:41.159401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b4d7c-f9aa-48ad-979d-5b1dd6cd21fd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:41.170267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b4d7c-f9aa-48ad-979d-5b1dd6cd21fd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:41.177748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42d7e2-d4ad-4b86-ac9a-cac1ca1c60ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:41.178348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42d7e2-d4ad-4b86-ac9a-cac1ca1c60ad admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.178717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42d7e2-d4ad-4b86-ac9a-cac1ca1c60ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.179175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42d7e2-d4ad-4b86-ac9a-cac1ca1c60ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.179797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42d7e2-d4ad-4b86-ac9a-cac1ca1c60ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:41.181584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42d7e2-d4ad-4b86-ac9a-cac1ca1c60ad admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:41.193665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 929/1865] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:41.196568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93a7d3-4b3c-4a4c-90f5-b787ab56bf07 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:41.207917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93a7d3-4b3c-4a4c-90f5-b787ab56bf07 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:41.212916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4723c6-1956-4da7-8690-5fc1320aaa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:41.213536 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4723c6-1956-4da7-8690-5fc1320aaa4b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.213864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4723c6-1956-4da7-8690-5fc1320aaa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.214182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4723c6-1956-4da7-8690-5fc1320aaa4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.221113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4723c6-1956-4da7-8690-5fc1320aaa4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:41.223066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4723c6-1956-4da7-8690-5fc1320aaa4b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:41.236914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 937/1866] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:41.240819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42d7e2-d4ad-4b86-ac9a-cac1ca1c60ad admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:41.253166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42d7e2-d4ad-4b86-ac9a-cac1ca1c60ad admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:41.260240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986df2c-26ed-4b0b-8ed4-25e0957c0f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:41.261039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986df2c-26ed-4b0b-8ed4-25e0957c0f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.262385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986df2c-26ed-4b0b-8ed4-25e0957c0f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.262746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986df2c-26ed-4b0b-8ed4-25e0957c0f4d admin admin] PATH_INFO: `/v3/projects/2424eae4edc34d898d8803b287f88b8a/users/79c0f71256b849ada94112bb60603064/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.289505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986df2c-26ed-4b0b-8ed4-25e0957c0f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2424eae4edc34d898d8803b287f88b8a, user_id=79c0f71256b849ada94112bb60603064, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:41.293362 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986df2c-26ed-4b0b-8ed4-25e0957c0f4d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:41.315326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 930/1867] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:41 2022] PUT /identity/v3/projects/2424eae4edc34d898d8803b287f88b8a/users/79c0f71256b849ada94112bb60603064/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:41.325839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e92794-399f-4709-ab19-4c6dba7452e6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.326483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e92794-399f-4709-ab19-4c6dba7452e6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.326704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e92794-399f-4709-ab19-4c6dba7452e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.350190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986df2c-26ed-4b0b-8ed4-25e0957c0f4d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:41.355439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1986df2c-26ed-4b0b-8ed4-25e0957c0f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:41.431486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a2e92794-399f-4709-ab19-4c6dba7452e6 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:41.432949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a2e92794-399f-4709-ab19-4c6dba7452e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:41.522559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986df2c-26ed-4b0b-8ed4-25e0957c0f4d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:41.536304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:41.536962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.537233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.537511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] PATH_INFO: `/v3/projects/f54f420b5dea4b369b82ccb30cc290d3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.540645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54f420b5dea4b369b82ccb30cc290d3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:41.542590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:41.591310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 938/1868] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:41.603531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e92794-399f-4709-ab19-4c6dba7452e6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:41.605212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a2e92794-399f-4709-ab19-4c6dba7452e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:41.631486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:41.637822 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:41.682566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54f420b5dea4b369b82ccb30cc290d3', 'request_id': 'req-df37ada6-5d06-49ee-82bb-2ececaac670a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:41.707094 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54f420b5dea4b369b82ccb30cc290d3', 'request_id': 'req-df37ada6-5d06-49ee-82bb-2ececaac670a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:41.711038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e92794-399f-4709-ab19-4c6dba7452e6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:41.718986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54f420b5dea4b369b82ccb30cc290d3', 'request_id': 'req-df37ada6-5d06-49ee-82bb-2ececaac670a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:41.732293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] The token cache is being invalidate because project f54f420b5dea4b369b82ccb30cc290d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:41.732836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:41.734948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-df37ada6-5d06-49ee-82bb-2ececaac670a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:41.736642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 931/1869] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:41 2022] DELETE /identity/v3/projects/f54f420b5dea4b369b82ccb30cc290d3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:41.741298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1faeb-5b23-462f-866a-698d02a7460a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.741665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1faeb-5b23-462f-866a-698d02a7460a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.741983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1faeb-5b23-462f-866a-698d02a7460a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.794010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bde1faeb-5b23-462f-866a-698d02a7460a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:41.795198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bde1faeb-5b23-462f-866a-698d02a7460a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:41.799850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec549b-7d27-4395-8de3-a5be1f7aa9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:41.801696 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec549b-7d27-4395-8de3-a5be1f7aa9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.802145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec549b-7d27-4395-8de3-a5be1f7aa9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.803122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec549b-7d27-4395-8de3-a5be1f7aa9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.805234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f5ec549b-7d27-4395-8de3-a5be1f7aa9e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:41.864128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 932/1870] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:41.871842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c51a6-11db-4eb8-a6a8-589da8577231 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.872126 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c51a6-11db-4eb8-a6a8-589da8577231 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.872406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c51a6-11db-4eb8-a6a8-589da8577231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.876307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec549b-7d27-4395-8de3-a5be1f7aa9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:41.877767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec549b-7d27-4395-8de3-a5be1f7aa9e3 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:41.888018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 939/1871] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:12:41.892693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4f0c51a6-11db-4eb8-a6a8-589da8577231 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:41.893921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4f0c51a6-11db-4eb8-a6a8-589da8577231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:41.901660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 933/1872] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:41.906495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec549b-7d27-4395-8de3-a5be1f7aa9e3 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:41.916558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec549b-7d27-4395-8de3-a5be1f7aa9e3 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:41.921364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228f54d-71c2-4f4c-a15a-656d52e7335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:41.922679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f54d-71c2-4f4c-a15a-656d52e7335f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.924103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f54d-71c2-4f4c-a15a-656d52e7335f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.924397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228f54d-71c2-4f4c-a15a-656d52e7335f admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.925049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f54d-71c2-4f4c-a15a-656d52e7335f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:41.925355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f54d-71c2-4f4c-a15a-656d52e7335f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:41.926961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228f54d-71c2-4f4c-a15a-656d52e7335f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:41.939158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 940/1873] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:41.943605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c51a6-11db-4eb8-a6a8-589da8577231 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:41.953550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c51a6-11db-4eb8-a6a8-589da8577231 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:41.958292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70774c-d2e1-42d2-b8f7-e07e0ba3f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:41.958886 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70774c-d2e1-42d2-b8f7-e07e0ba3f109 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:41.959162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70774c-d2e1-42d2-b8f7-e07e0ba3f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:41.959430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70774c-d2e1-42d2-b8f7-e07e0ba3f109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:41.960052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70774c-d2e1-42d2-b8f7-e07e0ba3f109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:41.962078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70774c-d2e1-42d2-b8f7-e07e0ba3f109 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:41.993491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 934/1874] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:41 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:41.994592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228f54d-71c2-4f4c-a15a-656d52e7335f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:42.005482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228f54d-71c2-4f4c-a15a-656d52e7335f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:42.069361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ec211-adc5-498e-9fbf-17d057bfd333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:42.070087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ec211-adc5-498e-9fbf-17d057bfd333 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:42.070390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ec211-adc5-498e-9fbf-17d057bfd333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:42.070649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ec211-adc5-498e-9fbf-17d057bfd333 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:42.071306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ec211-adc5-498e-9fbf-17d057bfd333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:42.073228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ec211-adc5-498e-9fbf-17d057bfd333 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:42.089103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:42.099747 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70774c-d2e1-42d2-b8f7-e07e0ba3f109 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:42.100418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 941/1875] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:41 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:12:42.111402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70774c-d2e1-42d2-b8f7-e07e0ba3f109 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:42.116243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124a060-d31e-4eda-9a8e-e882b0644678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:42.116851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124a060-d31e-4eda-9a8e-e882b0644678 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:42.117138 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124a060-d31e-4eda-9a8e-e882b0644678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:42.117416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124a060-d31e-4eda-9a8e-e882b0644678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:42.118090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124a060-d31e-4eda-9a8e-e882b0644678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:42.119809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124a060-d31e-4eda-9a8e-e882b0644678 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:42.135785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 935/1876] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:42.139601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ec211-adc5-498e-9fbf-17d057bfd333 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:42.150558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ec211-adc5-498e-9fbf-17d057bfd333 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:42.155345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72dfc9-770d-45b5-a4d0-cfc6657d7d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:42.155957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72dfc9-770d-45b5-a4d0-cfc6657d7d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:42.156284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72dfc9-770d-45b5-a4d0-cfc6657d7d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:42.156556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72dfc9-770d-45b5-a4d0-cfc6657d7d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:42.157324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72dfc9-770d-45b5-a4d0-cfc6657d7d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:42.158953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72dfc9-770d-45b5-a4d0-cfc6657d7d62 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:42.169567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 942/1877] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:42.174608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124a060-d31e-4eda-9a8e-e882b0644678 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:42.185331 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124a060-d31e-4eda-9a8e-e882b0644678 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:42.190232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e03f3c-b037-48cf-8d5c-ccde952559f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:42.190888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e03f3c-b037-48cf-8d5c-ccde952559f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:42.191167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e03f3c-b037-48cf-8d5c-ccde952559f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:42.191442 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e03f3c-b037-48cf-8d5c-ccde952559f0 admin admin] PATH_INFO: `/v3/projects/19a6287e3b7f4b8fbe595435a720520d/users/efd22a65317449cab1959317ae0dce1d/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:42.207609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e03f3c-b037-48cf-8d5c-ccde952559f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a6287e3b7f4b8fbe595435a720520d, user_id=efd22a65317449cab1959317ae0dce1d, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:42.210302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e03f3c-b037-48cf-8d5c-ccde952559f0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:42.225974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 936/1878] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:42 2022] PUT /identity/v3/projects/19a6287e3b7f4b8fbe595435a720520d/users/efd22a65317449cab1959317ae0dce1d/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:42.238642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebba35-1700-4953-9351-794ae4df07c6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:42.239047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebba35-1700-4953-9351-794ae4df07c6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:42.239392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebba35-1700-4953-9351-794ae4df07c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:42.277052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b2ebba35-1700-4953-9351-794ae4df07c6 None None] MFA Rules not processed for user `efd22a65317449cab1959317ae0dce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:42.278399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b2ebba35-1700-4953-9351-794ae4df07c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:42.348621 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 943/1879] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:42.361397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e03f3c-b037-48cf-8d5c-ccde952559f0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:42.363303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-56e03f3c-b037-48cf-8d5c-ccde952559f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:42.431736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e03f3c-b037-48cf-8d5c-ccde952559f0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:42.435088 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731a91b-7139-4620-8b98-6c680361154a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:42.435782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731a91b-7139-4620-8b98-6c680361154a service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:42.436129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731a91b-7139-4620-8b98-6c680361154a service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:42.436490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731a91b-7139-4620-8b98-6c680361154a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:42.444421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:42.447283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731a91b-7139-4620-8b98-6c680361154a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:42.448929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731a91b-7139-4620-8b98-6c680361154a service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:42.461036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 937/1880] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:12:42.482374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebba35-1700-4953-9351-794ae4df07c6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:42.558073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebba35-1700-4953-9351-794ae4df07c6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:42.564876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:42.565524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:42.565833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:42.566108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] PATH_INFO: `/v3/users/efd22a65317449cab1959317ae0dce1d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:42.567396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd22a65317449cab1959317ae0dce1d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:42.569470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:42.632125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd22a65317449cab1959317ae0dce1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:42.644101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd22a65317449cab1959317ae0dce1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:42.644769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd22a65317449cab1959317ae0dce1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:42.645519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd22a65317449cab1959317ae0dce1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:42.675660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd22a65317449cab1959317ae0dce1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:42.692699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:42.702280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 944/1881] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:42 2022] DELETE /identity/v3/users/efd22a65317449cab1959317ae0dce1d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:42.706894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f1527-6aae-4c2b-9e11-6c772f81ee7d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:42.707526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f1527-6aae-4c2b-9e11-6c772f81ee7d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:42.707994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f1527-6aae-4c2b-9e11-6c772f81ee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:42.744572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-766f1527-6aae-4c2b-9e11-6c772f81ee7d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:42.746601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-766f1527-6aae-4c2b-9e11-6c772f81ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:42.839761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 938/1882] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:42.846161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:42.848409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:42.890458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f1527-6aae-4c2b-9e11-6c772f81ee7d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:42.891723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-766f1527-6aae-4c2b-9e11-6c772f81ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:42.930366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f1527-6aae-4c2b-9e11-6c772f81ee7d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:42.946811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:42.947569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:42.947853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:42.948284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] PATH_INFO: `/v3/users/a93ba7857bc64a91a449d25f501207dd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:42.953380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a93ba7857bc64a91a449d25f501207dd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:42.956211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:42.974742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6fff3-d67f-4abf-9b8d-1156e75fc897 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:42.980591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2070f9-db17-4204-a8c1-edc955b7d7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:42.983531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2070f9-db17-4204-a8c1-edc955b7d7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:42.983891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2070f9-db17-4204-a8c1-edc955b7d7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:42.984826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2070f9-db17-4204-a8c1-edc955b7d7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:42.995887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2070f9-db17-4204-a8c1-edc955b7d7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:42.997524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2070f9-db17-4204-a8c1-edc955b7d7a8 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:43.011131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 945/1883] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:43.012866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cbab3-d41f-48ea-a9b5-780223088fbe None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.013293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cbab3-d41f-48ea-a9b5-780223088fbe None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.013532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cbab3-d41f-48ea-a9b5-780223088fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.048839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-040cbab3-d41f-48ea-a9b5-780223088fbe None None] MFA Rules not processed for user `79c0f71256b849ada94112bb60603064`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:43.050148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-040cbab3-d41f-48ea-a9b5-780223088fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:43.060625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93ba7857bc64a91a449d25f501207dd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:43.080233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93ba7857bc64a91a449d25f501207dd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:43.081170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93ba7857bc64a91a449d25f501207dd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:43.081870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93ba7857bc64a91a449d25f501207dd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:43.100648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-25962c37-22de-4a58-a40b-eaccc2de0105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93ba7857bc64a91a449d25f501207dd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:43.157890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 939/1884] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:42 2022] DELETE /identity/v3/users/a93ba7857bc64a91a449d25f501207dd => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:43.159192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6423e6-e8d4-4f3f-8870-d9a145aaeb9e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.159667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6423e6-e8d4-4f3f-8870-d9a145aaeb9e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.159941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6423e6-e8d4-4f3f-8870-d9a145aaeb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.182073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ea6423e6-e8d4-4f3f-8870-d9a145aaeb9e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:43.183358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ea6423e6-e8d4-4f3f-8870-d9a145aaeb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:43.200894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 946/1885] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:43.202259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cbab3-d41f-48ea-a9b5-780223088fbe None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:43.205259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-040cbab3-d41f-48ea-a9b5-780223088fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:43.224509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cbab3-d41f-48ea-a9b5-780223088fbe None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:43.282469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 940/1886] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:43.300143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6423e6-e8d4-4f3f-8870-d9a145aaeb9e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:43.303352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ea6423e6-e8d4-4f3f-8870-d9a145aaeb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:43.314710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638e041-a66a-4d4f-85b5-0c419fe02568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:43.315375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638e041-a66a-4d4f-85b5-0c419fe02568 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.316156 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638e041-a66a-4d4f-85b5-0c419fe02568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.316447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638e041-a66a-4d4f-85b5-0c419fe02568 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.316881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:43.318623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638e041-a66a-4d4f-85b5-0c419fe02568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:43.320947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638e041-a66a-4d4f-85b5-0c419fe02568 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:43.360795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 947/1887] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:43 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:12:43.364722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638e041-a66a-4d4f-85b5-0c419fe02568 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:43.392330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:43.398894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6423e6-e8d4-4f3f-8870-d9a145aaeb9e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:43.477732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638e041-a66a-4d4f-85b5-0c419fe02568 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:43.483463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a265af-236e-448e-b0d5-8a1c527a74cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:43.484678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a265af-236e-448e-b0d5-8a1c527a74cd admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.484923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a265af-236e-448e-b0d5-8a1c527a74cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.485420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a265af-236e-448e-b0d5-8a1c527a74cd admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.486127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a265af-236e-448e-b0d5-8a1c527a74cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:43.488307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a265af-236e-448e-b0d5-8a1c527a74cd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:43.504154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e9c9-ae7f-4a96-9f95-5907c98e78da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:43.504823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e9c9-ae7f-4a96-9f95-5907c98e78da service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.505103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e9c9-ae7f-4a96-9f95-5907c98e78da service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.505394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e9c9-ae7f-4a96-9f95-5907c98e78da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.517404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635e9c9-ae7f-4a96-9f95-5907c98e78da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:43.519222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635e9c9-ae7f-4a96-9f95-5907c98e78da service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:43.529919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 948/1888] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:43 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:43.529919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a265af-236e-448e-b0d5-8a1c527a74cd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:43.532600 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-41a265af-236e-448e-b0d5-8a1c527a74cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:43.533021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 941/1889] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:12:43.538502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e9c9-ae7f-4a96-9f95-5907c98e78da service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:43.549375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e9c9-ae7f-4a96-9f95-5907c98e78da service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:43.555990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6061435-4f56-4a79-80f4-6d66b66fac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:43.556148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a265af-236e-448e-b0d5-8a1c527a74cd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:43.556836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6061435-4f56-4a79-80f4-6d66b66fac61 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.557059 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6061435-4f56-4a79-80f4-6d66b66fac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.557401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6061435-4f56-4a79-80f4-6d66b66fac61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.558268 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6061435-4f56-4a79-80f4-6d66b66fac61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:43.559869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6061435-4f56-4a79-80f4-6d66b66fac61 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:43.563240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:43.563892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.564197 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.564457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] PATH_INFO: `/v3/projects/19a6287e3b7f4b8fbe595435a720520d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.565750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a6287e3b7f4b8fbe595435a720520d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:43.568399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:43.572288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 942/1890] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:43.580283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6061435-4f56-4a79-80f4-6d66b66fac61 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:43.596272 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6061435-4f56-4a79-80f4-6d66b66fac61 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:43.602097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407709b-0758-408d-a97b-c577b96eb43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:43.602863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407709b-0758-408d-a97b-c577b96eb43f admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.603149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407709b-0758-408d-a97b-c577b96eb43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.603428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407709b-0758-408d-a97b-c577b96eb43f admin admin] PATH_INFO: `/v3/projects/713667c3c7ee4c1cba6e0b2872d2d133/users/8f75b6daf2764ed89d97d64b67e071e8/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.628654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407709b-0758-408d-a97b-c577b96eb43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=713667c3c7ee4c1cba6e0b2872d2d133, user_id=8f75b6daf2764ed89d97d64b67e071e8, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:43.631715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407709b-0758-408d-a97b-c577b96eb43f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:43.642946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a6287e3b7f4b8fbe595435a720520d', 'request_id': 'req-3f36844b-2137-4fd8-9c0f-90cec88c2860'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:43.652589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 943/1891] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:43 2022] PUT /identity/v3/projects/713667c3c7ee4c1cba6e0b2872d2d133/users/8f75b6daf2764ed89d97d64b67e071e8/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:43.657709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a6287e3b7f4b8fbe595435a720520d', 'request_id': 'req-3f36844b-2137-4fd8-9c0f-90cec88c2860'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:43.659215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407709b-0758-408d-a97b-c577b96eb43f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:43.668455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a6287e3b7f4b8fbe595435a720520d', 'request_id': 'req-3f36844b-2137-4fd8-9c0f-90cec88c2860'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:43.683935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] The token cache is being invalidate because project 19a6287e3b7f4b8fbe595435a720520d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:43.683935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:43.684630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f36844b-2137-4fd8-9c0f-90cec88c2860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:43.686708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 949/1892] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:43 2022] DELETE /identity/v3/projects/19a6287e3b7f4b8fbe595435a720520d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:43.692995 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b0ef4-5065-422c-8930-21bdf642cf45 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.693323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b0ef4-5065-422c-8930-21bdf642cf45 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.693713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b0ef4-5065-422c-8930-21bdf642cf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.724161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4c3b0ef4-5065-422c-8930-21bdf642cf45 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:43.726306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4c3b0ef4-5065-422c-8930-21bdf642cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:43.760677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407709b-0758-408d-a97b-c577b96eb43f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:43.773692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7660187-edeb-425a-83a8-fc7bae90c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:43.774420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7660187-edeb-425a-83a8-fc7bae90c954 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.774778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7660187-edeb-425a-83a8-fc7bae90c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.775123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7660187-edeb-425a-83a8-fc7bae90c954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.775849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7660187-edeb-425a-83a8-fc7bae90c954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:43.777577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7660187-edeb-425a-83a8-fc7bae90c954 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:43.800890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 944/1893] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:43.801978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7660187-edeb-425a-83a8-fc7bae90c954 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:43.805044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e7660187-edeb-425a-83a8-fc7bae90c954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:43.819754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7660187-edeb-425a-83a8-fc7bae90c954 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:43.825340 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323412ec-7640-4f98-8520-d7355687fb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:43.826114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323412ec-7640-4f98-8520-d7355687fb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.826401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323412ec-7640-4f98-8520-d7355687fb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.826680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323412ec-7640-4f98-8520-d7355687fb3d admin admin] PATH_INFO: `/v3/projects/713667c3c7ee4c1cba6e0b2872d2d133/users/8f75b6daf2764ed89d97d64b67e071e8/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.829542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323412ec-7640-4f98-8520-d7355687fb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=713667c3c7ee4c1cba6e0b2872d2d133, user_id=8f75b6daf2764ed89d97d64b67e071e8, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:43.832517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323412ec-7640-4f98-8520-d7355687fb3d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:43.856420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 945/1894] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:43 2022] PUT /identity/v3/projects/713667c3c7ee4c1cba6e0b2872d2d133/users/8f75b6daf2764ed89d97d64b67e071e8/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:43.858775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 950/1895] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:43.867683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366e492-5e30-49b8-9d44-4ed399ded334 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:43.867970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366e492-5e30-49b8-9d44-4ed399ded334 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:43.868339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366e492-5e30-49b8-9d44-4ed399ded334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:43.911193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b0ef4-5065-422c-8930-21bdf642cf45 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:43.912639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4c3b0ef4-5065-422c-8930-21bdf642cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:43.923136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1366e492-5e30-49b8-9d44-4ed399ded334 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:43.925801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1366e492-5e30-49b8-9d44-4ed399ded334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:43.931113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b0ef4-5065-422c-8930-21bdf642cf45 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:43.946815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:43.995828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:44.035142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 946/1896] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:44.036594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366e492-5e30-49b8-9d44-4ed399ded334 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:44.052865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366e492-5e30-49b8-9d44-4ed399ded334 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:44.059550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94103ea1-e33c-4cc5-b72f-a4bd7e42da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:44.060637 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94103ea1-e33c-4cc5-b72f-a4bd7e42da51 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.061095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94103ea1-e33c-4cc5-b72f-a4bd7e42da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.061548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94103ea1-e33c-4cc5-b72f-a4bd7e42da51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.062706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94103ea1-e33c-4cc5-b72f-a4bd7e42da51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:44.063265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94103ea1-e33c-4cc5-b72f-a4bd7e42da51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:44.064983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:44.065776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.066119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.066502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] PATH_INFO: `/v3/projects/bdb9dff4e7d24593847413a8ef6e998a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.067015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94103ea1-e33c-4cc5-b72f-a4bd7e42da51 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:44.068186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb9dff4e7d24593847413a8ef6e998a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:44.070564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:44.086689 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 947/1897] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:44.091253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94103ea1-e33c-4cc5-b72f-a4bd7e42da51 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:44.107116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94103ea1-e33c-4cc5-b72f-a4bd7e42da51 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:44.117751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78416-a927-4b14-8f43-92ea83e441c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:44.118858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78416-a927-4b14-8f43-92ea83e441c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.119201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78416-a927-4b14-8f43-92ea83e441c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.119485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78416-a927-4b14-8f43-92ea83e441c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.120606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede78416-a927-4b14-8f43-92ea83e441c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:44.122641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede78416-a927-4b14-8f43-92ea83e441c8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:44.139531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb9dff4e7d24593847413a8ef6e998a', 'request_id': 'req-eb46574e-98eb-4c1c-9fd3-7385a42b7083'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:44.151041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb9dff4e7d24593847413a8ef6e998a', 'request_id': 'req-eb46574e-98eb-4c1c-9fd3-7385a42b7083'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:44.159135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb9dff4e7d24593847413a8ef6e998a', 'request_id': 'req-eb46574e-98eb-4c1c-9fd3-7385a42b7083'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:44.160399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 948/1898] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:44 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:44.164061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78416-a927-4b14-8f43-92ea83e441c8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:44.174281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] The token cache is being invalidate because project bdb9dff4e7d24593847413a8ef6e998a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:44.174580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:44.175267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:44.177835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 951/1899] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:43 2022] DELETE /identity/v3/projects/bdb9dff4e7d24593847413a8ef6e998a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:44.183584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:44.190497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:44.251402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78416-a927-4b14-8f43-92ea83e441c8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:44.256469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aa568-fcd6-4275-b05b-bf4f6df40cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:44.257152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aa568-fcd6-4275-b05b-bf4f6df40cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.257650 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aa568-fcd6-4275-b05b-bf4f6df40cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.258260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426aa568-fcd6-4275-b05b-bf4f6df40cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.258654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426aa568-fcd6-4275-b05b-bf4f6df40cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:44.262051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426aa568-fcd6-4275-b05b-bf4f6df40cd6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:44.265154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46574e-98eb-4c1c-9fd3-7385a42b7083 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:44.271299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:44.272004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.272444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.272805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] PATH_INFO: `/v3/users/0d7233c79e33453a82477289afaec94b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.274088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7233c79e33453a82477289afaec94b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:44.276246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:44.293983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 949/1900] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:44 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:12:44.295844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aa568-fcd6-4275-b05b-bf4f6df40cd6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:44.298244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-426aa568-fcd6-4275-b05b-bf4f6df40cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:44.315368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426aa568-fcd6-4275-b05b-bf4f6df40cd6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:44.324042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15a18b-7ede-4d31-8270-bf2eb7d673a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:44.328781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15a18b-7ede-4d31-8270-bf2eb7d673a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.329281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15a18b-7ede-4d31-8270-bf2eb7d673a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.329790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15a18b-7ede-4d31-8270-bf2eb7d673a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.330606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15a18b-7ede-4d31-8270-bf2eb7d673a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:44.332821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15a18b-7ede-4d31-8270-bf2eb7d673a8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:44.339965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7233c79e33453a82477289afaec94b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:44.350551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 950/1901] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:44.354587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7233c79e33453a82477289afaec94b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:44.355821 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7233c79e33453a82477289afaec94b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:44.356803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7233c79e33453a82477289afaec94b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:44.358217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15a18b-7ede-4d31-8270-bf2eb7d673a8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:44.359947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3d15a18b-7ede-4d31-8270-bf2eb7d673a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:44.364703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:44.371634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54182339-ec7b-475f-aab4-c4523d1153be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7233c79e33453a82477289afaec94b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:44.376554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15a18b-7ede-4d31-8270-bf2eb7d673a8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:44.382937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38858fe5-c011-415a-8b5c-e48fe9abccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:44.384571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38858fe5-c011-415a-8b5c-e48fe9abccbd admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.384973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38858fe5-c011-415a-8b5c-e48fe9abccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.385356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38858fe5-c011-415a-8b5c-e48fe9abccbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.386218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38858fe5-c011-415a-8b5c-e48fe9abccbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:44.388444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38858fe5-c011-415a-8b5c-e48fe9abccbd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:44.416485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 951/1902] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:12:44.418168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 952/1903] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:44 2022] DELETE /identity/v3/users/0d7233c79e33453a82477289afaec94b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:12:44.426605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38858fe5-c011-415a-8b5c-e48fe9abccbd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:44.452556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38858fe5-c011-415a-8b5c-e48fe9abccbd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:44.530593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:44.554231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5d1fa-8dec-485a-9817-ceb075b53e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:44.554920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d1fa-8dec-485a-9817-ceb075b53e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.555679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d1fa-8dec-485a-9817-ceb075b53e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.555679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d1fa-8dec-485a-9817-ceb075b53e9f admin admin] PATH_INFO: `/v3/projects/0443dda926b44953b6596ec8c656ec95/users/764c987fa7254055bbda88d90a65c571/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.580740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5d1fa-8dec-485a-9817-ceb075b53e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0443dda926b44953b6596ec8c656ec95, user_id=764c987fa7254055bbda88d90a65c571, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:44.584310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5d1fa-8dec-485a-9817-ceb075b53e9f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:44.608537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 952/1904] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:44 2022] PUT /identity/v3/projects/0443dda926b44953b6596ec8c656ec95/users/764c987fa7254055bbda88d90a65c571/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:44.620289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05daa6c-916a-4eaf-84c0-78e159c41725 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.620588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05daa6c-916a-4eaf-84c0-78e159c41725 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.620867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05daa6c-916a-4eaf-84c0-78e159c41725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.655677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a05daa6c-916a-4eaf-84c0-78e159c41725 None None] MFA Rules not processed for user `764c987fa7254055bbda88d90a65c571`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:44.657468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a05daa6c-916a-4eaf-84c0-78e159c41725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:44.771574 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 953/1905] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:44.782439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5d1fa-8dec-485a-9817-ceb075b53e9f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:44.784167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cac5d1fa-8dec-485a-9817-ceb075b53e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:44.924741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e25aa-de07-4c66-bec2-251c3fd55a68 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.925309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e25aa-de07-4c66-bec2-251c3fd55a68 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.925601 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e25aa-de07-4c66-bec2-251c3fd55a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.946035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5d1fa-8dec-485a-9817-ceb075b53e9f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:44.951955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84c0a1-eebd-4cfb-bd36-c7394b0bd0a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f20fbf033f04036b48194a804dae8c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:44.953436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84c0a1-eebd-4cfb-bd36-c7394b0bd0a6 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:44.954383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84c0a1-eebd-4cfb-bd36-c7394b0bd0a6 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:44.954383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84c0a1-eebd-4cfb-bd36-c7394b0bd0a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:44.976758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84c0a1-eebd-4cfb-bd36-c7394b0bd0a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:44.979251 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84c0a1-eebd-4cfb-bd36-c7394b0bd0a6 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:44.994488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 953/1906] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:44.996278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84c0a1-eebd-4cfb-bd36-c7394b0bd0a6 service glance] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:44.998394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4b84c0a1-eebd-4cfb-bd36-c7394b0bd0a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:45.049781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0a3e25aa-de07-4c66-bec2-251c3fd55a68 None None] MFA Rules not processed for user `8f75b6daf2764ed89d97d64b67e071e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:45.051382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0a3e25aa-de07-4c66-bec2-251c3fd55a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:45.146180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84c0a1-eebd-4cfb-bd36-c7394b0bd0a6 service glance] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:45.170237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:45.171025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:45.178443 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:45.179652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] PATH_INFO: `/v3/projects/58a70050354645df88c00f06ee670324` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:45.182036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a70050354645df88c00f06ee670324)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:45.188294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:45.283614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 954/1907] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:45.283614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8e12-db5e-47c1-96df-db440b1f7060 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:45.283614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8e12-db5e-47c1-96df-db440b1f7060 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:45.283614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8e12-db5e-47c1-96df-db440b1f7060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:45.324537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-818f8e12-db5e-47c1-96df-db440b1f7060 None None] MFA Rules not processed for user `79c0f71256b849ada94112bb60603064`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:45.326527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-818f8e12-db5e-47c1-96df-db440b1f7060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:45.326771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a70050354645df88c00f06ee670324', 'request_id': 'req-3b9dd332-1f1f-4756-9ee1-4118554263c7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:45.332580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:45.334311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a70050354645df88c00f06ee670324', 'request_id': 'req-3b9dd332-1f1f-4756-9ee1-4118554263c7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:45.353384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a70050354645df88c00f06ee670324', 'request_id': 'req-3b9dd332-1f1f-4756-9ee1-4118554263c7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:45.366764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] The token cache is being invalidate because project 58a70050354645df88c00f06ee670324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:45.367249 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:45.368107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b9dd332-1f1f-4756-9ee1-4118554263c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:45.373796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 954/1908] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:44 2022] DELETE /identity/v3/projects/58a70050354645df88c00f06ee670324 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:45.376073 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc55f98-788b-4383-8195-6deaba459391 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:45.376503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc55f98-788b-4383-8195-6deaba459391 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:45.376949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc55f98-788b-4383-8195-6deaba459391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:45.446489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-edc55f98-788b-4383-8195-6deaba459391 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:45.447724 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-edc55f98-788b-4383-8195-6deaba459391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:45.460848 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:45.489668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 955/1909] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:45.564659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 955/1910] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:45.572371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26b3a4-3cdd-43cb-bacb-e61bc173270b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:45.572673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26b3a4-3cdd-43cb-bacb-e61bc173270b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:45.572979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26b3a4-3cdd-43cb-bacb-e61bc173270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:45.596152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cd26b3a4-3cdd-43cb-bacb-e61bc173270b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:45.597369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cd26b3a4-3cdd-43cb-bacb-e61bc173270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:45.605755 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc55f98-788b-4383-8195-6deaba459391 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:45.607193 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-edc55f98-788b-4383-8195-6deaba459391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:45.628402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 956/1911] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:45.636037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26b3a4-3cdd-43cb-bacb-e61bc173270b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:45.660775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26b3a4-3cdd-43cb-bacb-e61bc173270b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:45.674521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b862a99-c36c-47e0-a00a-64fbc23725de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:45.674521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b862a99-c36c-47e0-a00a-64fbc23725de admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:45.674808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b862a99-c36c-47e0-a00a-64fbc23725de admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:45.675078 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b862a99-c36c-47e0-a00a-64fbc23725de admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:45.675837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b862a99-c36c-47e0-a00a-64fbc23725de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:12:45.676151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b862a99-c36c-47e0-a00a-64fbc23725de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:45.679449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b862a99-c36c-47e0-a00a-64fbc23725de admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:45.696151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 957/1912] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:12:45.701046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b862a99-c36c-47e0-a00a-64fbc23725de admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:45.712975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b862a99-c36c-47e0-a00a-64fbc23725de admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:45.718778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817261cf-1133-4b4c-b832-8ba67f61e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:45.719465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817261cf-1133-4b4c-b832-8ba67f61e948 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:45.719747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817261cf-1133-4b4c-b832-8ba67f61e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:45.720023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817261cf-1133-4b4c-b832-8ba67f61e948 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:45.720718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817261cf-1133-4b4c-b832-8ba67f61e948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:45.722777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817261cf-1133-4b4c-b832-8ba67f61e948 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:45.756063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc55f98-788b-4383-8195-6deaba459391 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:45.765642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726593a-db46-4a9d-a908-a20be8980eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:45.767580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726593a-db46-4a9d-a908-a20be8980eda service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:45.767870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726593a-db46-4a9d-a908-a20be8980eda service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:45.768203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726593a-db46-4a9d-a908-a20be8980eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:45.770621 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8726593a-db46-4a9d-a908-a20be8980eda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:45.774497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 958/1913] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:45 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:45.776489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817261cf-1133-4b4c-b832-8ba67f61e948 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:45.835321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726593a-db46-4a9d-a908-a20be8980eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:45.837496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726593a-db46-4a9d-a908-a20be8980eda service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:45.851457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 956/1914] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:12:45.940440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817261cf-1133-4b4c-b832-8ba67f61e948 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:45.945948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c56ead-d9dd-4592-bcc0-132acbcf8de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:45.946317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c56ead-d9dd-4592-bcc0-132acbcf8de7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:45.946603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c56ead-d9dd-4592-bcc0-132acbcf8de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:45.946878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c56ead-d9dd-4592-bcc0-132acbcf8de7 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:45.947517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c56ead-d9dd-4592-bcc0-132acbcf8de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:45.949759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c56ead-d9dd-4592-bcc0-132acbcf8de7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:46.012779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 959/1915] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:45 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:46.013908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726593a-db46-4a9d-a908-a20be8980eda service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:46.029684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726593a-db46-4a9d-a908-a20be8980eda service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:46.038108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9751037-fc2a-41bb-861c-0e496fd414b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:46.038994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9751037-fc2a-41bb-861c-0e496fd414b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:46.039653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9751037-fc2a-41bb-861c-0e496fd414b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:46.040084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9751037-fc2a-41bb-861c-0e496fd414b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:46.041381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9751037-fc2a-41bb-861c-0e496fd414b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:46.044267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9751037-fc2a-41bb-861c-0e496fd414b5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:46.061667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 957/1916] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:12:46.063831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c56ead-d9dd-4592-bcc0-132acbcf8de7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:46.089386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c56ead-d9dd-4592-bcc0-132acbcf8de7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:46.095883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a29d44-e981-43fb-8e8f-2873c1e5520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:46.097666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a29d44-e981-43fb-8e8f-2873c1e5520e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:46.098149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a29d44-e981-43fb-8e8f-2873c1e5520e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:46.098590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a29d44-e981-43fb-8e8f-2873c1e5520e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:46.099448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a29d44-e981-43fb-8e8f-2873c1e5520e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:46.101463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a29d44-e981-43fb-8e8f-2873c1e5520e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:46.121868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 960/1917] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:46.122790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9751037-fc2a-41bb-861c-0e496fd414b5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:46.135690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9751037-fc2a-41bb-861c-0e496fd414b5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:46.142402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4ab50-817a-412f-8c31-370040bb59fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:46.144576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ab50-817a-412f-8c31-370040bb59fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:46.144875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ab50-817a-412f-8c31-370040bb59fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:46.145207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ab50-817a-412f-8c31-370040bb59fa admin admin] PATH_INFO: `/v3/projects/710b7c8642b04bdca49b5316495f3398/users/8d1cae1abf5343698da2ca1a8427b7c4/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:46.170104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4ab50-817a-412f-8c31-370040bb59fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=710b7c8642b04bdca49b5316495f3398, user_id=8d1cae1abf5343698da2ca1a8427b7c4, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:46.175247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4ab50-817a-412f-8c31-370040bb59fa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:46.201601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 958/1918] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:46 2022] PUT /identity/v3/projects/710b7c8642b04bdca49b5316495f3398/users/8d1cae1abf5343698da2ca1a8427b7c4/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:12:46.213784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0e8c5-03a2-4070-b83e-76718ae3d738 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:46.214079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0e8c5-03a2-4070-b83e-76718ae3d738 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:46.214352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0e8c5-03a2-4070-b83e-76718ae3d738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:46.283155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-28f0e8c5-03a2-4070-b83e-76718ae3d738 None None] MFA Rules not processed for user `8d1cae1abf5343698da2ca1a8427b7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:46.285339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-28f0e8c5-03a2-4070-b83e-76718ae3d738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:46.436694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 961/1919] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:46.438886 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4ab50-817a-412f-8c31-370040bb59fa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:46.534444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:46.582226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4ab50-817a-412f-8c31-370040bb59fa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:46.587663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9861152-028b-4a6d-b819-005b79559fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:46.590994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9861152-028b-4a6d-b819-005b79559fbe admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:46.594934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9861152-028b-4a6d-b819-005b79559fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:46.595401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9861152-028b-4a6d-b819-005b79559fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:46.600145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9861152-028b-4a6d-b819-005b79559fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:46.602569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9861152-028b-4a6d-b819-005b79559fbe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:46.700295 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 959/1920] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:46 2022] POST /identity/v3/projects => generated 387 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:46.704403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0e8c5-03a2-4070-b83e-76718ae3d738 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:46.722762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0e8c5-03a2-4070-b83e-76718ae3d738 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:46.791054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:46.900309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1581-0af9-4218-8b6a-7e5132f2e3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:46.900970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1581-0af9-4218-8b6a-7e5132f2e3fb admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:46.901246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1581-0af9-4218-8b6a-7e5132f2e3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:46.901516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1581-0af9-4218-8b6a-7e5132f2e3fb admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:46.902207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a1581-0af9-4218-8b6a-7e5132f2e3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:46.904819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a1581-0af9-4218-8b6a-7e5132f2e3fb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:46.964316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 962/1921] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:46 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:12:46.968280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9861152-028b-4a6d-b819-005b79559fbe admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:47.001301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9861152-028b-4a6d-b819-005b79559fbe admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:47.017970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20371b-4903-4cf5-b60b-d4f502bfa956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:47.018718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20371b-4903-4cf5-b60b-d4f502bfa956 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:47.018718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20371b-4903-4cf5-b60b-d4f502bfa956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:47.018718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20371b-4903-4cf5-b60b-d4f502bfa956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:47.019343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20371b-4903-4cf5-b60b-d4f502bfa956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:47.020951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20371b-4903-4cf5-b60b-d4f502bfa956 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:47.044547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 960/1922] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:47.049181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1581-0af9-4218-8b6a-7e5132f2e3fb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:47.060422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1581-0af9-4218-8b6a-7e5132f2e3fb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:47.071952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3c984-3711-4949-bf8f-0fb7cbe38e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:47.072852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3c984-3711-4949-bf8f-0fb7cbe38e08 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:47.073339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3c984-3711-4949-bf8f-0fb7cbe38e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:47.073861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3c984-3711-4949-bf8f-0fb7cbe38e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:47.074712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3c984-3711-4949-bf8f-0fb7cbe38e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:47.076526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3c984-3711-4949-bf8f-0fb7cbe38e08 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:47.089267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 963/1923] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:47.094320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20371b-4903-4cf5-b60b-d4f502bfa956 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:47.106187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20371b-4903-4cf5-b60b-d4f502bfa956 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:47.113611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6643-24f0-4a7f-b5b6-d323fbb30739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:47.114741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6643-24f0-4a7f-b5b6-d323fbb30739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:47.115247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6643-24f0-4a7f-b5b6-d323fbb30739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:47.115738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6643-24f0-4a7f-b5b6-d323fbb30739 admin admin] PATH_INFO: `/v3/projects/ee55b45b0c414b07b738207dc3ad7b45/users/fb7a7696aa254226a924d8ff82610254/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:47.147988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c6643-24f0-4a7f-b5b6-d323fbb30739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee55b45b0c414b07b738207dc3ad7b45, user_id=fb7a7696aa254226a924d8ff82610254, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:47.151524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c6643-24f0-4a7f-b5b6-d323fbb30739 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:47.202303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 961/1924] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:47 2022] PUT /identity/v3/projects/ee55b45b0c414b07b738207dc3ad7b45/users/fb7a7696aa254226a924d8ff82610254/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:12:47.214125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93028-c007-4de2-98a7-88edb5204e1c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:47.214423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93028-c007-4de2-98a7-88edb5204e1c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:47.214907 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93028-c007-4de2-98a7-88edb5204e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:47.316875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1de93028-c007-4de2-98a7-88edb5204e1c None None] MFA Rules not processed for user `fb7a7696aa254226a924d8ff82610254`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:47.324235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1de93028-c007-4de2-98a7-88edb5204e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:47.451119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 964/1925] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:12:47.456302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6643-24f0-4a7f-b5b6-d323fbb30739 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:47.554842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6643-24f0-4a7f-b5b6-d323fbb30739 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:47.560562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9f82-2ef2-4336-a254-752127db85d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:47.561276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9f82-2ef2-4336-a254-752127db85d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:47.561675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9f82-2ef2-4336-a254-752127db85d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:47.562227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9f82-2ef2-4336-a254-752127db85d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:47.563463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d9f82-2ef2-4336-a254-752127db85d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:47.565522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d9f82-2ef2-4336-a254-752127db85d8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:47.628911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 962/1926] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:12:47 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:47.636404 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de93028-c007-4de2-98a7-88edb5204e1c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:47.671365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de93028-c007-4de2-98a7-88edb5204e1c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:47.799993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26629b01-bd8d-455f-b066-5b91e294a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:47.800633 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26629b01-bd8d-455f-b066-5b91e294a570 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:47.800914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26629b01-bd8d-455f-b066-5b91e294a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:47.801197 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26629b01-bd8d-455f-b066-5b91e294a570 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:47.802542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26629b01-bd8d-455f-b066-5b91e294a570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:47.805058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26629b01-bd8d-455f-b066-5b91e294a570 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:47.847344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 965/1927] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:12:47 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:12:47.847885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9f82-2ef2-4336-a254-752127db85d8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:47.869875 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9f82-2ef2-4336-a254-752127db85d8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:47.875655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55b701-53f8-4bf2-b822-036a6a092cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:47.876541 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55b701-53f8-4bf2-b822-036a6a092cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:47.876541 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55b701-53f8-4bf2-b822-036a6a092cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:47.876930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55b701-53f8-4bf2-b822-036a6a092cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:47.877546 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55b701-53f8-4bf2-b822-036a6a092cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:47.879371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55b701-53f8-4bf2-b822-036a6a092cc1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:47.898536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 963/1928] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:47.901224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26629b01-bd8d-455f-b066-5b91e294a570 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:47.916640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26629b01-bd8d-455f-b066-5b91e294a570 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:47.922675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf790b5-43ca-4c72-866c-3b4392510b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:47.923559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf790b5-43ca-4c72-866c-3b4392510b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:47.923846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf790b5-43ca-4c72-866c-3b4392510b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:47.924124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf790b5-43ca-4c72-866c-3b4392510b6d admin admin] PATH_INFO: `/v3/projects/19e74f1596084fbc846e5b7583332203/users/7121eaf887894031a986d7ab46772f78/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:47.942327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf790b5-43ca-4c72-866c-3b4392510b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e74f1596084fbc846e5b7583332203, user_id=7121eaf887894031a986d7ab46772f78, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:47.945197 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf790b5-43ca-4c72-866c-3b4392510b6d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:47.948744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:47.981020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 966/1929] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:47 2022] PUT /identity/v3/projects/19e74f1596084fbc846e5b7583332203/users/7121eaf887894031a986d7ab46772f78/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:47.989446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55b701-53f8-4bf2-b822-036a6a092cc1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:48.006493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55b701-53f8-4bf2-b822-036a6a092cc1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:48.101450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae7828-7e93-4b0e-8941-73fb73a51cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:48.102119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae7828-7e93-4b0e-8941-73fb73a51cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:48.102210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae7828-7e93-4b0e-8941-73fb73a51cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:48.102456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae7828-7e93-4b0e-8941-73fb73a51cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:48.103113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae7828-7e93-4b0e-8941-73fb73a51cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:48.105649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae7828-7e93-4b0e-8941-73fb73a51cf0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:48.106800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:48.129197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 964/1930] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:12:48.130682 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf790b5-43ca-4c72-866c-3b4392510b6d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:48.149964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf790b5-43ca-4c72-866c-3b4392510b6d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:48.156964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa1e3d-2b3d-40fd-85df-99b7ce0c64aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:48.158059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1e3d-2b3d-40fd-85df-99b7ce0c64aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:48.158763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1e3d-2b3d-40fd-85df-99b7ce0c64aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:48.159506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1e3d-2b3d-40fd-85df-99b7ce0c64aa admin admin] PATH_INFO: `/v3/projects/19e74f1596084fbc846e5b7583332203/users/7121eaf887894031a986d7ab46772f78/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:48.163082 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa1e3d-2b3d-40fd-85df-99b7ce0c64aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e74f1596084fbc846e5b7583332203, user_id=7121eaf887894031a986d7ab46772f78, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:48.166748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa1e3d-2b3d-40fd-85df-99b7ce0c64aa admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:48.183318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 967/1931] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:12:48 2022] PUT /identity/v3/projects/19e74f1596084fbc846e5b7583332203/users/7121eaf887894031a986d7ab46772f78/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:48.197214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ac5c1-b89a-46ae-b091-1ca1ff08a880 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:48.197807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ac5c1-b89a-46ae-b091-1ca1ff08a880 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:48.198418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ac5c1-b89a-46ae-b091-1ca1ff08a880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:48.241161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a84ac5c1-b89a-46ae-b091-1ca1ff08a880 None None] MFA Rules not processed for user `7121eaf887894031a986d7ab46772f78`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:48.243641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a84ac5c1-b89a-46ae-b091-1ca1ff08a880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:48.403224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 965/1932] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:48.415131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa1e3d-2b3d-40fd-85df-99b7ce0c64aa admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:48.417537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d2fa1e3d-2b3d-40fd-85df-99b7ce0c64aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:48.511423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa1e3d-2b3d-40fd-85df-99b7ce0c64aa admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:48.515476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a73014-90b7-4b07-af55-da42dc466741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:48.516126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a73014-90b7-4b07-af55-da42dc466741 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:48.516403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a73014-90b7-4b07-af55-da42dc466741 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:48.516674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a73014-90b7-4b07-af55-da42dc466741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:48.538469 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a73014-90b7-4b07-af55-da42dc466741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:48.540001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a73014-90b7-4b07-af55-da42dc466741 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:48.552427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 968/1933] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:49.188716 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ac5c1-b89a-46ae-b091-1ca1ff08a880 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:49.190362 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a84ac5c1-b89a-46ae-b091-1ca1ff08a880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:49.202238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ac5c1-b89a-46ae-b091-1ca1ff08a880 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:49.206965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f7e0c-c95b-425d-9bf2-69796439e5dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:49.207568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f7e0c-c95b-425d-9bf2-69796439e5dc service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:49.207844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f7e0c-c95b-425d-9bf2-69796439e5dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:49.208113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f7e0c-c95b-425d-9bf2-69796439e5dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:49.268114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f7e0c-c95b-425d-9bf2-69796439e5dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:49.269538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f7e0c-c95b-425d-9bf2-69796439e5dc service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:49.279252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 966/1934] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:49.759594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b23b-2467-4e0d-ac71-2194aeebbec3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:49.760132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b23b-2467-4e0d-ac71-2194aeebbec3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:49.760132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b23b-2467-4e0d-ac71-2194aeebbec3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:49.761586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 969/1935] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:12:49.771668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52a302-d363-420e-ad26-a4bb569828e9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:49.772097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52a302-d363-420e-ad26-a4bb569828e9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:49.772437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52a302-d363-420e-ad26-a4bb569828e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:49.795651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ea52a302-d363-420e-ad26-a4bb569828e9 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:49.796942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ea52a302-d363-420e-ad26-a4bb569828e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:49.908550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 967/1936] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:12:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:49.957949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97b23b-2467-4e0d-ac71-2194aeebbec3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:49.970352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97b23b-2467-4e0d-ac71-2194aeebbec3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:49.979105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07924-783b-4f0b-9cc9-16a1e6316e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:49.979375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07924-783b-4f0b-9cc9-16a1e6316e90 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:49.980008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07924-783b-4f0b-9cc9-16a1e6316e90 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:49.980379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07924-783b-4f0b-9cc9-16a1e6316e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:49.993418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b07924-783b-4f0b-9cc9-16a1e6316e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:49.995041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b07924-783b-4f0b-9cc9-16a1e6316e90 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:50.007892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 970/1937] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:54.050919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52a302-d363-420e-ad26-a4bb569828e9 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:54.068162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52a302-d363-420e-ad26-a4bb569828e9 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:54.082445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e670a-e385-4254-9630-213dd1fc6b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:54.083354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e670a-e385-4254-9630-213dd1fc6b26 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:54.089691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e670a-e385-4254-9630-213dd1fc6b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:54.090221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e670a-e385-4254-9630-213dd1fc6b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:54.105564 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:54.191143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e670a-e385-4254-9630-213dd1fc6b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:54.193228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e670a-e385-4254-9630-213dd1fc6b26 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:54.219475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 968/1938] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:57.084742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07924-783b-4f0b-9cc9-16a1e6316e90 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:57.226545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07924-783b-4f0b-9cc9-16a1e6316e90 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:57.233221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:57.235278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:57.235886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:57.236340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] PATH_INFO: `/v3/users/8d1cae1abf5343698da2ca1a8427b7c4` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:57.237838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1cae1abf5343698da2ca1a8427b7c4)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:57.240242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:57.311721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1cae1abf5343698da2ca1a8427b7c4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:57.328277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1cae1abf5343698da2ca1a8427b7c4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:57.329288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1cae1abf5343698da2ca1a8427b7c4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:57.330217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1cae1abf5343698da2ca1a8427b7c4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:57.342450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1cae1abf5343698da2ca1a8427b7c4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:57.363969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:57.380106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 971/1939] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:57 2022] DELETE /identity/v3/users/8d1cae1abf5343698da2ca1a8427b7c4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:57.384667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5cff5-a144-4347-9b27-06cbfa85481e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:57.385508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5cff5-a144-4347-9b27-06cbfa85481e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:57.386053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5cff5-a144-4347-9b27-06cbfa85481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:57.408238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-20c5cff5-a144-4347-9b27-06cbfa85481e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:12:57.411463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-20c5cff5-a144-4347-9b27-06cbfa85481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:57.485583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 969/1940] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:12:57.495162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:57.496806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:57.559271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e108e-e2a9-47b9-938d-faa33078d127 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:57.563319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9798bf-58cf-4d8d-958f-c7eecc8dfd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:57.564020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9798bf-58cf-4d8d-958f-c7eecc8dfd0e service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:57.564373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9798bf-58cf-4d8d-958f-c7eecc8dfd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:57.564598 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9798bf-58cf-4d8d-958f-c7eecc8dfd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:57.573789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9798bf-58cf-4d8d-958f-c7eecc8dfd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:57.575409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9798bf-58cf-4d8d-958f-c7eecc8dfd0e service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:57.585412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 972/1941] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:58.121532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5cff5-a144-4347-9b27-06cbfa85481e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:58.123586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-20c5cff5-a144-4347-9b27-06cbfa85481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:58.136370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5cff5-a144-4347-9b27-06cbfa85481e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:58.146180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:58.146840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:58.147293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:58.147817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] PATH_INFO: `/v3/projects/710b7c8642b04bdca49b5316495f3398` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:58.149108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710b7c8642b04bdca49b5316495f3398)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:58.150912 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:58.200329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710b7c8642b04bdca49b5316495f3398', 'request_id': 'req-4791713b-cd1b-403f-8d96-693f8133eb42'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:58.206918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710b7c8642b04bdca49b5316495f3398', 'request_id': 'req-4791713b-cd1b-403f-8d96-693f8133eb42'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:58.216431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710b7c8642b04bdca49b5316495f3398', 'request_id': 'req-4791713b-cd1b-403f-8d96-693f8133eb42'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:58.233611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] The token cache is being invalidate because project 710b7c8642b04bdca49b5316495f3398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:58.234283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:58.235216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:58.236781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 970/1942] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:58 2022] DELETE /identity/v3/projects/710b7c8642b04bdca49b5316495f3398 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:58.241466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9798bf-58cf-4d8d-958f-c7eecc8dfd0e service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:58.251782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9798bf-58cf-4d8d-958f-c7eecc8dfd0e service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:58.331911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:58.332987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:58.333484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:58.333798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] PATH_INFO: `/v3/users/fb7a7696aa254226a924d8ff82610254` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:58.335425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7a7696aa254226a924d8ff82610254)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:58.337803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:58.403617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7a7696aa254226a924d8ff82610254'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:58.431357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7a7696aa254226a924d8ff82610254'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:58.432472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7a7696aa254226a924d8ff82610254'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:58.433155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7a7696aa254226a924d8ff82610254'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:58.444290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7a7696aa254226a924d8ff82610254'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:58.465081 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 973/1943] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:58 2022] DELETE /identity/v3/users/fb7a7696aa254226a924d8ff82610254 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:59.068420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:59.070314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:59.084912 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791713b-cd1b-403f-8d96-693f8133eb42 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:59.128155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:59.165951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:59.166589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:59.166878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:59.167157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] PATH_INFO: `/v3/projects/ee55b45b0c414b07b738207dc3ad7b45` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:59.168315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee55b45b0c414b07b738207dc3ad7b45)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:59.170293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:59.218781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee55b45b0c414b07b738207dc3ad7b45', 'request_id': 'req-f74905ff-010f-48c2-8290-a9eaa25d3a0d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.224692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee55b45b0c414b07b738207dc3ad7b45', 'request_id': 'req-f74905ff-010f-48c2-8290-a9eaa25d3a0d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.233140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee55b45b0c414b07b738207dc3ad7b45', 'request_id': 'req-f74905ff-010f-48c2-8290-a9eaa25d3a0d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.244988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] The token cache is being invalidate because project ee55b45b0c414b07b738207dc3ad7b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:12:59.245308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.245984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.250691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 971/1944] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:59 2022] DELETE /identity/v3/projects/ee55b45b0c414b07b738207dc3ad7b45 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:59.252322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:59.254540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:59.274863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a27a63-017a-4449-bb94-42ea55f8835a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:59.285456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:59.342247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:59.342923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:59.343887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:59.344403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] PATH_INFO: `/v3/users/7121eaf887894031a986d7ab46772f78` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:59.345634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7121eaf887894031a986d7ab46772f78)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:59.347567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:59.396689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7121eaf887894031a986d7ab46772f78'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.403886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7121eaf887894031a986d7ab46772f78'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.404741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7121eaf887894031a986d7ab46772f78'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.405352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7121eaf887894031a986d7ab46772f78'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.414571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fcfcd7e-eab4-4e0c-87ed-ec7b6725c06c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7121eaf887894031a986d7ab46772f78'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.432683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 974/1945] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:12:59 2022] DELETE /identity/v3/users/7121eaf887894031a986d7ab46772f78 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:12:59.770746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:59.772309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:59.788175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74905ff-010f-48c2-8290-a9eaa25d3a0d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:59.870882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:59.871878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:59.872221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:59.872493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] PATH_INFO: `/v3/projects/19e74f1596084fbc846e5b7583332203` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:59.874157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e74f1596084fbc846e5b7583332203)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:59.876293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:59.943500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e74f1596084fbc846e5b7583332203', 'request_id': 'req-74a402ff-a5d7-4789-9370-f2ccc380bdf2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.951242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e74f1596084fbc846e5b7583332203', 'request_id': 'req-74a402ff-a5d7-4789-9370-f2ccc380bdf2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.967914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e74f1596084fbc846e5b7583332203', 'request_id': 'req-74a402ff-a5d7-4789-9370-f2ccc380bdf2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:12:59.969940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:00.001185 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] The token cache is being invalidate because project 19e74f1596084fbc846e5b7583332203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:00.001582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:00.003924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-74a402ff-a5d7-4789-9370-f2ccc380bdf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:00.017674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 972/1946] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:12:59 2022] DELETE /identity/v3/projects/19e74f1596084fbc846e5b7583332203 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:00.018110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11447aa4-fe23-4e2f-a350-04bebe862a73 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.018110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11447aa4-fe23-4e2f-a350-04bebe862a73 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.018110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11447aa4-fe23-4e2f-a350-04bebe862a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.063471 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-11447aa4-fe23-4e2f-a350-04bebe862a73 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:00.064699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-11447aa4-fe23-4e2f-a350-04bebe862a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:00.165159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 975/1947] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:00.174939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4e49f-5f6d-46b3-9f59-d508687bab08 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.175377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4e49f-5f6d-46b3-9f59-d508687bab08 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.175662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4e49f-5f6d-46b3-9f59-d508687bab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.197494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-35f4e49f-5f6d-46b3-9f59-d508687bab08 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:00.198880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-35f4e49f-5f6d-46b3-9f59-d508687bab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:00.207686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 973/1948] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:00.212109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11447aa4-fe23-4e2f-a350-04bebe862a73 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:00.222602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11447aa4-fe23-4e2f-a350-04bebe862a73 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:00.228294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253400-9f95-44cf-a4bf-5ea7102821d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:00.228957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253400-9f95-44cf-a4bf-5ea7102821d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.229231 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253400-9f95-44cf-a4bf-5ea7102821d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.229500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253400-9f95-44cf-a4bf-5ea7102821d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.230455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99253400-9f95-44cf-a4bf-5ea7102821d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:00.230760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99253400-9f95-44cf-a4bf-5ea7102821d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:00.232342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99253400-9f95-44cf-a4bf-5ea7102821d3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:00.250270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 976/1949] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:13:00.251680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4e49f-5f6d-46b3-9f59-d508687bab08 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:00.261403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4e49f-5f6d-46b3-9f59-d508687bab08 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:00.267498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa4c51-26c3-4ef7-9983-c2995f7723ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:00.268113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa4c51-26c3-4ef7-9983-c2995f7723ee admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.268391 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa4c51-26c3-4ef7-9983-c2995f7723ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.268660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa4c51-26c3-4ef7-9983-c2995f7723ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.269307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa4c51-26c3-4ef7-9983-c2995f7723ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:00.271384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa4c51-26c3-4ef7-9983-c2995f7723ee admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:00.310379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 974/1950] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:00 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:00.315025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253400-9f95-44cf-a4bf-5ea7102821d3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:00.327866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253400-9f95-44cf-a4bf-5ea7102821d3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:00.351940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:00.413085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fec5d-302f-4d8e-bc8d-62878a151597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:00.413766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fec5d-302f-4d8e-bc8d-62878a151597 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.414049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fec5d-302f-4d8e-bc8d-62878a151597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.414318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fec5d-302f-4d8e-bc8d-62878a151597 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.414984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fec5d-302f-4d8e-bc8d-62878a151597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:00.417029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fec5d-302f-4d8e-bc8d-62878a151597 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:00.441695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 977/1951] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:00 2022] POST /identity/v3/users => generated 301 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:00.442945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa4c51-26c3-4ef7-9983-c2995f7723ee admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:00.454887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa4c51-26c3-4ef7-9983-c2995f7723ee admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:00.459707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c98bd-d8ec-45d7-a4a9-f38bd44de9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:00.460310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c98bd-d8ec-45d7-a4a9-f38bd44de9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.460588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c98bd-d8ec-45d7-a4a9-f38bd44de9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.460859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c98bd-d8ec-45d7-a4a9-f38bd44de9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.461496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c98bd-d8ec-45d7-a4a9-f38bd44de9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:00.463108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c98bd-d8ec-45d7-a4a9-f38bd44de9b7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:00.473822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 975/1952] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:00.478077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fec5d-302f-4d8e-bc8d-62878a151597 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:00.490248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fec5d-302f-4d8e-bc8d-62878a151597 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:00.496266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a23fe8-3cec-413d-a375-27e8509f3cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:00.496900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23fe8-3cec-413d-a375-27e8509f3cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.497179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23fe8-3cec-413d-a375-27e8509f3cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.497508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23fe8-3cec-413d-a375-27e8509f3cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.498178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a23fe8-3cec-413d-a375-27e8509f3cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:00.499862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a23fe8-3cec-413d-a375-27e8509f3cd6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:00.513658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 978/1953] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:00.515439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c98bd-d8ec-45d7-a4a9-f38bd44de9b7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:00.525226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c98bd-d8ec-45d7-a4a9-f38bd44de9b7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:00.530063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddad1b7-a37b-43ac-a7f9-6c687ff2a8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:00.531257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad1b7-a37b-43ac-a7f9-6c687ff2a8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.531673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad1b7-a37b-43ac-a7f9-6c687ff2a8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.531980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad1b7-a37b-43ac-a7f9-6c687ff2a8ab admin admin] PATH_INFO: `/v3/projects/f0cf907a00f94c6b9d9cbe1b9ce15be1/users/6a26b83900cd4706bb87f0bc202bddc0/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.547352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddad1b7-a37b-43ac-a7f9-6c687ff2a8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cf907a00f94c6b9d9cbe1b9ce15be1, user_id=6a26b83900cd4706bb87f0bc202bddc0, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:00.550035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddad1b7-a37b-43ac-a7f9-6c687ff2a8ab admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:00.562466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 976/1954] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:00 2022] PUT /identity/v3/projects/f0cf907a00f94c6b9d9cbe1b9ce15be1/users/6a26b83900cd4706bb87f0bc202bddc0/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:00.573486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2e520-89b5-4f03-abf6-1b4d2a6cd13d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.573802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2e520-89b5-4f03-abf6-1b4d2a6cd13d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.574081 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2e520-89b5-4f03-abf6-1b4d2a6cd13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.601171 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3ff2e520-89b5-4f03-abf6-1b4d2a6cd13d None None] MFA Rules not processed for user `6a26b83900cd4706bb87f0bc202bddc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:00.602381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3ff2e520-89b5-4f03-abf6-1b4d2a6cd13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:00.667716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 979/1955] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:00.673855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddad1b7-a37b-43ac-a7f9-6c687ff2a8ab admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:00.735653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddad1b7-a37b-43ac-a7f9-6c687ff2a8ab admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:00.740336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad635d6-ccdf-4d2c-8b2d-2ad8de057ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:00.740932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad635d6-ccdf-4d2c-8b2d-2ad8de057ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.741211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad635d6-ccdf-4d2c-8b2d-2ad8de057ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.741481 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad635d6-ccdf-4d2c-8b2d-2ad8de057ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.742158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad635d6-ccdf-4d2c-8b2d-2ad8de057ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:00.744030 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad635d6-ccdf-4d2c-8b2d-2ad8de057ba5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:00.774779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 977/1956] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:00 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:00.776020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2e520-89b5-4f03-abf6-1b4d2a6cd13d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:00.787496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2e520-89b5-4f03-abf6-1b4d2a6cd13d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:00.873746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77aa813-3fc3-4bcd-8beb-b8a45e9bb246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:00.874722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aa813-3fc3-4bcd-8beb-b8a45e9bb246 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.875225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aa813-3fc3-4bcd-8beb-b8a45e9bb246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.875687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aa813-3fc3-4bcd-8beb-b8a45e9bb246 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.876525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aa813-3fc3-4bcd-8beb-b8a45e9bb246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:00.878784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aa813-3fc3-4bcd-8beb-b8a45e9bb246 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:00.900992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 980/1957] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:00 2022] POST /identity/v3/users => generated 307 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:00.905128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad635d6-ccdf-4d2c-8b2d-2ad8de057ba5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:00.917695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad635d6-ccdf-4d2c-8b2d-2ad8de057ba5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:00.922928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b53ece-ab6b-419f-8c4d-f79cc0ca8d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:00.923475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b53ece-ab6b-419f-8c4d-f79cc0ca8d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.923779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b53ece-ab6b-419f-8c4d-f79cc0ca8d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.924052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b53ece-ab6b-419f-8c4d-f79cc0ca8d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.924691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b53ece-ab6b-419f-8c4d-f79cc0ca8d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:00.926317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b53ece-ab6b-419f-8c4d-f79cc0ca8d73 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:00.936974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 978/1958] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:00.941079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77aa813-3fc3-4bcd-8beb-b8a45e9bb246 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:00.951896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77aa813-3fc3-4bcd-8beb-b8a45e9bb246 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:00.957240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7d13b-c737-4766-98e1-54d15ad6f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:00.957909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7d13b-c737-4766-98e1-54d15ad6f267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:00.958189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7d13b-c737-4766-98e1-54d15ad6f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:00.958461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7d13b-c737-4766-98e1-54d15ad6f267 admin admin] PATH_INFO: `/v3/projects/b9351808f4de4c298e1e26245476ced8/users/ab445432229b437d93aac6550bb0e567/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:00.973841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7d13b-c737-4766-98e1-54d15ad6f267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9351808f4de4c298e1e26245476ced8, user_id=ab445432229b437d93aac6550bb0e567, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:00.977126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7d13b-c737-4766-98e1-54d15ad6f267 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:00.979549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:00.994692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 981/1959] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:00 2022] PUT /identity/v3/projects/b9351808f4de4c298e1e26245476ced8/users/ab445432229b437d93aac6550bb0e567/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:00.998959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b53ece-ab6b-419f-8c4d-f79cc0ca8d73 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:01.014797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b53ece-ab6b-419f-8c4d-f79cc0ca8d73 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:01.107508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91499193-765c-4926-ba35-7b22e660625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:01.107683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91499193-765c-4926-ba35-7b22e660625b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:01.107919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91499193-765c-4926-ba35-7b22e660625b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:01.108243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91499193-765c-4926-ba35-7b22e660625b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:01.109674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91499193-765c-4926-ba35-7b22e660625b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:01.111929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91499193-765c-4926-ba35-7b22e660625b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:01.119810 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:01.129003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 979/1960] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:01.130309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7d13b-c737-4766-98e1-54d15ad6f267 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:01.143687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7d13b-c737-4766-98e1-54d15ad6f267 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:01.150740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1979d-7efa-4ed2-8da0-e3be29160a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:01.151503 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1979d-7efa-4ed2-8da0-e3be29160a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:01.151795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1979d-7efa-4ed2-8da0-e3be29160a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:01.152075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1979d-7efa-4ed2-8da0-e3be29160a71 admin admin] PATH_INFO: `/v3/projects/b9351808f4de4c298e1e26245476ced8/users/ab445432229b437d93aac6550bb0e567/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:01.154635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1979d-7efa-4ed2-8da0-e3be29160a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9351808f4de4c298e1e26245476ced8, user_id=ab445432229b437d93aac6550bb0e567, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:01.159337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1979d-7efa-4ed2-8da0-e3be29160a71 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:01.174037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 982/1961] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:01 2022] PUT /identity/v3/projects/b9351808f4de4c298e1e26245476ced8/users/ab445432229b437d93aac6550bb0e567/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:01.186358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1255e3b-6382-4251-98ea-7aff4c565ba6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:01.186801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1255e3b-6382-4251-98ea-7aff4c565ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:01.187481 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1255e3b-6382-4251-98ea-7aff4c565ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:01.226125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d1255e3b-6382-4251-98ea-7aff4c565ba6 None None] MFA Rules not processed for user `ab445432229b437d93aac6550bb0e567`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:01.227098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d1255e3b-6382-4251-98ea-7aff4c565ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:01.301631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 980/1962] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:01 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:01.313137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1979d-7efa-4ed2-8da0-e3be29160a71 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:01.314907 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9ea1979d-7efa-4ed2-8da0-e3be29160a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:01.387232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1979d-7efa-4ed2-8da0-e3be29160a71 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:01.392415 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f7dbf-fc8b-44f0-a1e5-0c043d9adbdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:01.393348 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7dbf-fc8b-44f0-a1e5-0c043d9adbdf service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:01.393697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7dbf-fc8b-44f0-a1e5-0c043d9adbdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:01.394015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7dbf-fc8b-44f0-a1e5-0c043d9adbdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:01.406725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f7dbf-fc8b-44f0-a1e5-0c043d9adbdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:01.409122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f7dbf-fc8b-44f0-a1e5-0c043d9adbdf service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:01.434525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 983/1963] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:01 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:01.512309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1255e3b-6382-4251-98ea-7aff4c565ba6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:01.522951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1255e3b-6382-4251-98ea-7aff4c565ba6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:01.526710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31e016-46af-43f0-94db-b2cfa36b10a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:01.527343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31e016-46af-43f0-94db-b2cfa36b10a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:01.527623 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31e016-46af-43f0-94db-b2cfa36b10a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:01.527891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31e016-46af-43f0-94db-b2cfa36b10a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:01.599534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31e016-46af-43f0-94db-b2cfa36b10a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:01.600981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31e016-46af-43f0-94db-b2cfa36b10a6 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:01.612043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 981/1964] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:01 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:05.699268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f7dbf-fc8b-44f0-a1e5-0c043d9adbdf service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:05.700766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bd7f7dbf-fc8b-44f0-a1e5-0c043d9adbdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:05.768968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f7dbf-fc8b-44f0-a1e5-0c043d9adbdf service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:05.774244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:05.775653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:05.775918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:05.776200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] PATH_INFO: `/v3/users/d4f214b8daa6434b9b5dea71f33366c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:05.778447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f214b8daa6434b9b5dea71f33366c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:05.781177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:05.838807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f214b8daa6434b9b5dea71f33366c7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:05.848985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f214b8daa6434b9b5dea71f33366c7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:05.849858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f214b8daa6434b9b5dea71f33366c7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:05.850356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f214b8daa6434b9b5dea71f33366c7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:05.861491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f214b8daa6434b9b5dea71f33366c7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:05.888236 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 984/1965] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:05 2022] DELETE /identity/v3/users/d4f214b8daa6434b9b5dea71f33366c7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:05.893850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bc90b-c3d5-4a59-949e-c78cc5cf9a12 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:05.894839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bc90b-c3d5-4a59-949e-c78cc5cf9a12 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:05.895303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bc90b-c3d5-4a59-949e-c78cc5cf9a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:05.900981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:05.902477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:05.908448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:05.918879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-765bc90b-c3d5-4a59-949e-c78cc5cf9a12 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:05.920190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-765bc90b-c3d5-4a59-949e-c78cc5cf9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:05.977842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c124a9c-5820-4394-bb09-55e8415da14b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:05.983325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:05.984696 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:05.985208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:05.985584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] PATH_INFO: `/v3/users/6a26b83900cd4706bb87f0bc202bddc0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:05.986868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a26b83900cd4706bb87f0bc202bddc0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:05.988892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:06.001472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 982/1966] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:06.007977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bc90b-c3d5-4a59-949e-c78cc5cf9a12 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:06.009348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-765bc90b-c3d5-4a59-949e-c78cc5cf9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:06.039583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:06.043223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a26b83900cd4706bb87f0bc202bddc0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:06.052387 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a26b83900cd4706bb87f0bc202bddc0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:06.053014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a26b83900cd4706bb87f0bc202bddc0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:06.053762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a26b83900cd4706bb87f0bc202bddc0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:06.060839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b4e72c78-2687-44ff-8c17-c9eb68764093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a26b83900cd4706bb87f0bc202bddc0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:06.071209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bc90b-c3d5-4a59-949e-c78cc5cf9a12 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:06.074812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988e24-96e3-4e34-8a3d-6f0fe9dafc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:06.075417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988e24-96e3-4e34-8a3d-6f0fe9dafc6b service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:06.075727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988e24-96e3-4e34-8a3d-6f0fe9dafc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:06.076003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988e24-96e3-4e34-8a3d-6f0fe9dafc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:06.078672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0d988e24-96e3-4e34-8a3d-6f0fe9dafc6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:06.079702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 985/1967] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:05 2022] DELETE /identity/v3/users/6a26b83900cd4706bb87f0bc202bddc0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:06.083859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65edd6-a6ac-4bfd-8b44-85adc5d3f41b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:06.084149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65edd6-a6ac-4bfd-8b44-85adc5d3f41b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:06.084451 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65edd6-a6ac-4bfd-8b44-85adc5d3f41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:06.092065 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d988e24-96e3-4e34-8a3d-6f0fe9dafc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:06.094214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d988e24-96e3-4e34-8a3d-6f0fe9dafc6b service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:06.108922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2a65edd6-a6ac-4bfd-8b44-85adc5d3f41b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:06.110383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2a65edd6-a6ac-4bfd-8b44-85adc5d3f41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:06.113798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 983/1968] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:06.179244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 986/1969] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:06.215499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988e24-96e3-4e34-8a3d-6f0fe9dafc6b service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:06.217210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0d988e24-96e3-4e34-8a3d-6f0fe9dafc6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:06.227987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988e24-96e3-4e34-8a3d-6f0fe9dafc6b service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:06.287385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa925f9-b783-40c6-92e5-356630534e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:06.288283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa925f9-b783-40c6-92e5-356630534e06 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:06.288711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa925f9-b783-40c6-92e5-356630534e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:06.289040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa925f9-b783-40c6-92e5-356630534e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:06.299388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa925f9-b783-40c6-92e5-356630534e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:06.300836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa925f9-b783-40c6-92e5-356630534e06 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:06.319035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 984/1970] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:07.236930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65edd6-a6ac-4bfd-8b44-85adc5d3f41b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:07.239329 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2a65edd6-a6ac-4bfd-8b44-85adc5d3f41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:07.252499 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65edd6-a6ac-4bfd-8b44-85adc5d3f41b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:07.258440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:07.259380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:07.259945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:07.260500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] PATH_INFO: `/v3/projects/836951e5905f4388bb635f8312e22db8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:07.262418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=836951e5905f4388bb635f8312e22db8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:07.264577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:07.272223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa925f9-b783-40c6-92e5-356630534e06 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:07.274585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cfa925f9-b783-40c6-92e5-356630534e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:07.295777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:07.299779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa925f9-b783-40c6-92e5-356630534e06 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:07.322455 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:07.323018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:07.328586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:07.329115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] PATH_INFO: `/v3/projects/f0cf907a00f94c6b9d9cbe1b9ce15be1` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:07.330599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0cf907a00f94c6b9d9cbe1b9ce15be1)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:07.332741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:07.361414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836951e5905f4388bb635f8312e22db8', 'request_id': 'req-14fa1844-465d-4de2-b52e-c52f83c748d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.372630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836951e5905f4388bb635f8312e22db8', 'request_id': 'req-14fa1844-465d-4de2-b52e-c52f83c748d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.380203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836951e5905f4388bb635f8312e22db8', 'request_id': 'req-14fa1844-465d-4de2-b52e-c52f83c748d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.407410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] The token cache is being invalidate because project 836951e5905f4388bb635f8312e22db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:07.407712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.411705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.414535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 987/1971] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:07 2022] DELETE /identity/v3/projects/836951e5905f4388bb635f8312e22db8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:07.418268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:07.419675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:07.430063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0cf907a00f94c6b9d9cbe1b9ce15be1', 'request_id': 'req-ab7f591a-b20d-4141-9657-30a9838987bf'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.431653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0cf907a00f94c6b9d9cbe1b9ce15be1', 'request_id': 'req-ab7f591a-b20d-4141-9657-30a9838987bf'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.442715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0cf907a00f94c6b9d9cbe1b9ce15be1', 'request_id': 'req-ab7f591a-b20d-4141-9657-30a9838987bf'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.458999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] The token cache is being invalidate because project f0cf907a00f94c6b9d9cbe1b9ce15be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:07.459681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.460406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.462025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 985/1972] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:07 2022] DELETE /identity/v3/projects/f0cf907a00f94c6b9d9cbe1b9ce15be1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:07.465943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:07.467569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:07.501837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa1844-465d-4de2-b52e-c52f83c748d3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:07.531713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:07.547716 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f591a-b20d-4141-9657-30a9838987bf admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:07.553982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:07.554631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:07.555313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:07.555587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] PATH_INFO: `/v3/users/ab445432229b437d93aac6550bb0e567` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:07.557356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab445432229b437d93aac6550bb0e567)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:07.559293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:07.563885 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:07.564590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:07.564927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:07.565254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] PATH_INFO: `/v3/users/fe76ea16969e44ecbbabe4467b25b204` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:07.566497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe76ea16969e44ecbbabe4467b25b204)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:07.568506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:07.610430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab445432229b437d93aac6550bb0e567'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.617693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab445432229b437d93aac6550bb0e567'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.618501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab445432229b437d93aac6550bb0e567'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.618827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe76ea16969e44ecbbabe4467b25b204'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.619124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab445432229b437d93aac6550bb0e567'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.626216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe76ea16969e44ecbbabe4467b25b204'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.626847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe76ea16969e44ecbbabe4467b25b204'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.627056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab445432229b437d93aac6550bb0e567'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.627482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe76ea16969e44ecbbabe4467b25b204'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.628721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:07.638140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe76ea16969e44ecbbabe4467b25b204'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:07.645415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 986/1973] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:07 2022] DELETE /identity/v3/users/ab445432229b437d93aac6550bb0e567 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:07.657845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 988/1974] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:07 2022] DELETE /identity/v3/users/fe76ea16969e44ecbbabe4467b25b204 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:07.978760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:07.981161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:08.046528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.048395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:08.101508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a2678-aea1-478c-bc24-aa06db5e763b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.168018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab9065-38fe-4b35-b542-65f317281263 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.176275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.176867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.177082 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.177361 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.177661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] PATH_INFO: `/v3/projects/340b234afb7c4b8ab6bd28a06a167d8b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.178056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.178431 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.178778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] PATH_INFO: `/v3/projects/b9351808f4de4c298e1e26245476ced8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.180074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=340b234afb7c4b8ab6bd28a06a167d8b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.181109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9351808f4de4c298e1e26245476ced8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.182210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.183740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.247555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:08.271616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9351808f4de4c298e1e26245476ced8', 'request_id': 'req-e852efb8-c5fe-4fde-b437-48092cae2bc5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:08.284073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9351808f4de4c298e1e26245476ced8', 'request_id': 'req-e852efb8-c5fe-4fde-b437-48092cae2bc5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:08.293867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9351808f4de4c298e1e26245476ced8', 'request_id': 'req-e852efb8-c5fe-4fde-b437-48092cae2bc5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:08.304872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340b234afb7c4b8ab6bd28a06a167d8b', 'request_id': 'req-80f070e4-8033-4553-863f-7295e4c70fbc'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:08.312813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340b234afb7c4b8ab6bd28a06a167d8b', 'request_id': 'req-80f070e4-8033-4553-863f-7295e4c70fbc'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:08.315228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] The token cache is being invalidate because project b9351808f4de4c298e1e26245476ced8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:08.315659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:08.316400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e852efb8-c5fe-4fde-b437-48092cae2bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:08.318178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 989/1975] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:08 2022] DELETE /identity/v3/projects/b9351808f4de4c298e1e26245476ced8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:08.323086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340b234afb7c4b8ab6bd28a06a167d8b', 'request_id': 'req-80f070e4-8033-4553-863f-7295e4c70fbc'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:08.323801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d703a-0bdf-4b78-b8cd-66b13952182d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.324096 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d703a-0bdf-4b78-b8cd-66b13952182d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.324473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d703a-0bdf-4b78-b8cd-66b13952182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.339544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] The token cache is being invalidate because project 340b234afb7c4b8ab6bd28a06a167d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:08.340051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:08.341038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-80f070e4-8033-4553-863f-7295e4c70fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:08.343566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 987/1976] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:07 2022] DELETE /identity/v3/projects/340b234afb7c4b8ab6bd28a06a167d8b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:08.348816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdead3-d62e-4556-8f12-806885d7b974 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.350157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdead3-d62e-4556-8f12-806885d7b974 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.353257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdead3-d62e-4556-8f12-806885d7b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.356460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e25d703a-0bdf-4b78-b8cd-66b13952182d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:08.361748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e25d703a-0bdf-4b78-b8cd-66b13952182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:08.392942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-81cdead3-d62e-4556-8f12-806885d7b974 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:08.394744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-81cdead3-d62e-4556-8f12-806885d7b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:08.451878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 990/1977] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:08.460606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c13a7c-35b4-40f2-b907-1698258dfd88 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.460892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c13a7c-35b4-40f2-b907-1698258dfd88 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.461237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c13a7c-35b4-40f2-b907-1698258dfd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.474826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:08.497114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b7c13a7c-35b4-40f2-b907-1698258dfd88 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:08.499074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b7c13a7c-35b4-40f2-b907-1698258dfd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:08.507565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 988/1978] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:08.516933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3d14-c1d5-4ef0-bc4d-52a699994cf8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.517303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3d14-c1d5-4ef0-bc4d-52a699994cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.517579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3d14-c1d5-4ef0-bc4d-52a699994cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.522980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 991/1979] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:08.526835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c13a7c-35b4-40f2-b907-1698258dfd88 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.537226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c13a7c-35b4-40f2-b907-1698258dfd88 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.541077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1d4b3d14-c1d5-4ef0-bc4d-52a699994cf8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:08.541844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3cb15-24a9-49fd-94b8-1713406f9e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.542438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3cb15-24a9-49fd-94b8-1713406f9e08 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.542542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1d4b3d14-c1d5-4ef0-bc4d-52a699994cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:08.542715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3cb15-24a9-49fd-94b8-1713406f9e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.542991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3cb15-24a9-49fd-94b8-1713406f9e08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.543626 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3cb15-24a9-49fd-94b8-1713406f9e08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:08.543925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3cb15-24a9-49fd-94b8-1713406f9e08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.545492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3cb15-24a9-49fd-94b8-1713406f9e08 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.550648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 989/1980] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:08.554533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3d14-c1d5-4ef0-bc4d-52a699994cf8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.558276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 992/1981] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:13:08.563807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3cb15-24a9-49fd-94b8-1713406f9e08 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.564492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3d14-c1d5-4ef0-bc4d-52a699994cf8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.570455 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308a279-d74b-4a16-aefa-95e3d75c9c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.571055 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308a279-d74b-4a16-aefa-95e3d75c9c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.571335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308a279-d74b-4a16-aefa-95e3d75c9c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.571604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308a279-d74b-4a16-aefa-95e3d75c9c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.572243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308a279-d74b-4a16-aefa-95e3d75c9c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:08.572545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308a279-d74b-4a16-aefa-95e3d75c9c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.573650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3cb15-24a9-49fd-94b8-1713406f9e08 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.574151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308a279-d74b-4a16-aefa-95e3d75c9c28 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.579999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443e8be-65e3-4f1b-b4e0-ffac82200dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.580597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443e8be-65e3-4f1b-b4e0-ffac82200dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.580880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443e8be-65e3-4f1b-b4e0-ffac82200dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.581156 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443e8be-65e3-4f1b-b4e0-ffac82200dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.581825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443e8be-65e3-4f1b-b4e0-ffac82200dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.583726 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443e8be-65e3-4f1b-b4e0-ffac82200dc3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.590411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 990/1982] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:13:08.591275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308a279-d74b-4a16-aefa-95e3d75c9c28 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.601429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308a279-d74b-4a16-aefa-95e3d75c9c28 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.608705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b90c65-d514-4ce1-bfab-e4884b312f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.609439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b90c65-d514-4ce1-bfab-e4884b312f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.609753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b90c65-d514-4ce1-bfab-e4884b312f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.610042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b90c65-d514-4ce1-bfab-e4884b312f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.610666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b90c65-d514-4ce1-bfab-e4884b312f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.612625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b90c65-d514-4ce1-bfab-e4884b312f59 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.617665 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 993/1983] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:08 2022] POST /identity/v3/projects => generated 409 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:08.619687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443e8be-65e3-4f1b-b4e0-ffac82200dc3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.651591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 991/1984] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:08 2022] POST /identity/v3/projects => generated 355 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:08.653471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b90c65-d514-4ce1-bfab-e4884b312f59 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.701854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443e8be-65e3-4f1b-b4e0-ffac82200dc3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.737686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b90c65-d514-4ce1-bfab-e4884b312f59 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.743097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bec84-8985-4c87-902f-e05310d32800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.743820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bec84-8985-4c87-902f-e05310d32800 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.744196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bec84-8985-4c87-902f-e05310d32800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.744504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bec84-8985-4c87-902f-e05310d32800 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.745206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bec84-8985-4c87-902f-e05310d32800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.747216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bec84-8985-4c87-902f-e05310d32800 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.765299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:08.766458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310686a-cb0d-443c-94b4-4692da3529b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.767218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310686a-cb0d-443c-94b4-4692da3529b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.767931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310686a-cb0d-443c-94b4-4692da3529b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.768288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310686a-cb0d-443c-94b4-4692da3529b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.768989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310686a-cb0d-443c-94b4-4692da3529b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.771261 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310686a-cb0d-443c-94b4-4692da3529b4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.777099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 992/1985] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:08 2022] POST /identity/v3/users => generated 278 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:08.778102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bec84-8985-4c87-902f-e05310d32800 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.788292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bec84-8985-4c87-902f-e05310d32800 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.794209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe2ff-bf29-48cf-be23-5aab4d6771a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.794805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe2ff-bf29-48cf-be23-5aab4d6771a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.795086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe2ff-bf29-48cf-be23-5aab4d6771a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.795358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe2ff-bf29-48cf-be23-5aab4d6771a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.796033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbe2ff-bf29-48cf-be23-5aab4d6771a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.798644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbe2ff-bf29-48cf-be23-5aab4d6771a9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.799148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 994/1986] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:08 2022] POST /identity/v3/users => generated 305 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:08.803123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310686a-cb0d-443c-94b4-4692da3529b4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.809663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 993/1987] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:08.812957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe2ff-bf29-48cf-be23-5aab4d6771a9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.818853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310686a-cb0d-443c-94b4-4692da3529b4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.823286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe2ff-bf29-48cf-be23-5aab4d6771a9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.824693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982964d-f68b-4488-b7aa-4b38ab9ca744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.825300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982964d-f68b-4488-b7aa-4b38ab9ca744 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.825582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982964d-f68b-4488-b7aa-4b38ab9ca744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.825891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982964d-f68b-4488-b7aa-4b38ab9ca744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.826535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982964d-f68b-4488-b7aa-4b38ab9ca744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.828034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8aae-79c7-4375-8be2-b1413aedaf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.828169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982964d-f68b-4488-b7aa-4b38ab9ca744 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.828696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8aae-79c7-4375-8be2-b1413aedaf73 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.828971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8aae-79c7-4375-8be2-b1413aedaf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.829237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8aae-79c7-4375-8be2-b1413aedaf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.830078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8aae-79c7-4375-8be2-b1413aedaf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.832017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8aae-79c7-4375-8be2-b1413aedaf73 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.841299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 995/1988] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:08.847043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 994/1989] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:08.847450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982964d-f68b-4488-b7aa-4b38ab9ca744 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.848675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8aae-79c7-4375-8be2-b1413aedaf73 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.857287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982964d-f68b-4488-b7aa-4b38ab9ca744 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.858503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8aae-79c7-4375-8be2-b1413aedaf73 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.862890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e05a2-d594-4dfc-af69-928ed977a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.863539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e05a2-d594-4dfc-af69-928ed977a706 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.863666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8ff91-c4e7-46d6-a047-e023ed876e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.864018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e05a2-d594-4dfc-af69-928ed977a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.864294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8ff91-c4e7-46d6-a047-e023ed876e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.864466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e05a2-d594-4dfc-af69-928ed977a706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.864570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8ff91-c4e7-46d6-a047-e023ed876e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.864832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8ff91-c4e7-46d6-a047-e023ed876e76 admin admin] PATH_INFO: `/v3/projects/b09c039697184665b55409474432eba5/users/70fd71730f85489691510092141f3c0b/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.865378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e05a2-d594-4dfc-af69-928ed977a706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.867085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e05a2-d594-4dfc-af69-928ed977a706 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.877769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 996/1990] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:08.881917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e05a2-d594-4dfc-af69-928ed977a706 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:08.882636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8ff91-c4e7-46d6-a047-e023ed876e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09c039697184665b55409474432eba5, user_id=70fd71730f85489691510092141f3c0b, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.885382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8ff91-c4e7-46d6-a047-e023ed876e76 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.891936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e05a2-d594-4dfc-af69-928ed977a706 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:08.898813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 995/1991] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:08 2022] PUT /identity/v3/projects/b09c039697184665b55409474432eba5/users/70fd71730f85489691510092141f3c0b/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:08.909999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7597c-4282-43f5-8a73-89a1c7c51c55 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.910282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7597c-4282-43f5-8a73-89a1c7c51c55 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.910555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7597c-4282-43f5-8a73-89a1c7c51c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.926573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:08.940469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-86b7597c-4282-43f5-8a73-89a1c7c51c55 None None] MFA Rules not processed for user `70fd71730f85489691510092141f3c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:08.941723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-86b7597c-4282-43f5-8a73-89a1c7c51c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:08.951824 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c460c-a309-4c60-a400-9c5aa7752987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:08.953398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c460c-a309-4c60-a400-9c5aa7752987 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.953702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c460c-a309-4c60-a400-9c5aa7752987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.954005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c460c-a309-4c60-a400-9c5aa7752987 admin admin] PATH_INFO: `/v3/projects/c70507357477475298ab79b29fb132c7/users/d8547f3890b14334b28854697d645c0e/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:08.969298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c460c-a309-4c60-a400-9c5aa7752987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70507357477475298ab79b29fb132c7, user_id=d8547f3890b14334b28854697d645c0e, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:08.971958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c460c-a309-4c60-a400-9c5aa7752987 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:08.985926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 997/1992] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:08 2022] PUT /identity/v3/projects/c70507357477475298ab79b29fb132c7/users/d8547f3890b14334b28854697d645c0e/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:08.996024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888012-32ac-40a4-abaa-e3c31e362472 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:08.996310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888012-32ac-40a4-abaa-e3c31e362472 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:08.996585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888012-32ac-40a4-abaa-e3c31e362472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.009706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 996/1993] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:09.014211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7597c-4282-43f5-8a73-89a1c7c51c55 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.024099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e1888012-32ac-40a4-abaa-e3c31e362472 None None] MFA Rules not processed for user `d8547f3890b14334b28854697d645c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:09.024880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7597c-4282-43f5-8a73-89a1c7c51c55 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.025371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e1888012-32ac-40a4-abaa-e3c31e362472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:09.094324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7b6f4-ae1d-42b0-8e29-03d867b65ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.094984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b6f4-ae1d-42b0-8e29-03d867b65ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.095270 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b6f4-ae1d-42b0-8e29-03d867b65ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.095545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b6f4-ae1d-42b0-8e29-03d867b65ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.096326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7b6f4-ae1d-42b0-8e29-03d867b65ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.098247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 998/1994] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:09.098364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7b6f4-ae1d-42b0-8e29-03d867b65ca4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.104593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888012-32ac-40a4-abaa-e3c31e362472 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.116571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888012-32ac-40a4-abaa-e3c31e362472 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.121476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ffd84-fce3-4399-8ffa-cd40b87be2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.122316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ffd84-fce3-4399-8ffa-cd40b87be2ae admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.122594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ffd84-fce3-4399-8ffa-cd40b87be2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.122867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ffd84-fce3-4399-8ffa-cd40b87be2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.123655 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ffd84-fce3-4399-8ffa-cd40b87be2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.127020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ffd84-fce3-4399-8ffa-cd40b87be2ae admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.137377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 997/1995] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:09 2022] POST /identity/v3/projects => generated 355 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:09.141697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7b6f4-ae1d-42b0-8e29-03d867b65ca4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.160216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 999/1996] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:09 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:09.161667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ffd84-fce3-4399-8ffa-cd40b87be2ae admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.175570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:09.212749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7b6f4-ae1d-42b0-8e29-03d867b65ca4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.236995 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ffd84-fce3-4399-8ffa-cd40b87be2ae admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.242430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a6933-444a-47fa-acd1-2f10b7a47691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.243207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a6933-444a-47fa-acd1-2f10b7a47691 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.243487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a6933-444a-47fa-acd1-2f10b7a47691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.243769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a6933-444a-47fa-acd1-2f10b7a47691 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.244407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a6933-444a-47fa-acd1-2f10b7a47691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.246411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a6933-444a-47fa-acd1-2f10b7a47691 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.269879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1000/1997] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:09 2022] POST /identity/v3/users => generated 311 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:09.273640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a6933-444a-47fa-acd1-2f10b7a47691 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.275906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d6091-5a0d-4063-a72d-e75024511c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.276517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d6091-5a0d-4063-a72d-e75024511c0c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.276798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d6091-5a0d-4063-a72d-e75024511c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.277072 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d6091-5a0d-4063-a72d-e75024511c0c admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.277751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d6091-5a0d-4063-a72d-e75024511c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.279654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d6091-5a0d-4063-a72d-e75024511c0c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.283321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a6933-444a-47fa-acd1-2f10b7a47691 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.287781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31778c-5b2d-449d-ba88-4c8cd3d81e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.288365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31778c-5b2d-449d-ba88-4c8cd3d81e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.288648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31778c-5b2d-449d-ba88-4c8cd3d81e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.288921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31778c-5b2d-449d-ba88-4c8cd3d81e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.289550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31778c-5b2d-449d-ba88-4c8cd3d81e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.291187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31778c-5b2d-449d-ba88-4c8cd3d81e19 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.301725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 998/1998] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:09 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:09.301967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1001/1999] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:09.305859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d6091-5a0d-4063-a72d-e75024511c0c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.306398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31778c-5b2d-449d-ba88-4c8cd3d81e19 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.313015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:09.316069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31778c-5b2d-449d-ba88-4c8cd3d81e19 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.316919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d6091-5a0d-4063-a72d-e75024511c0c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.321764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f0b4e-6ef2-48e3-b932-f2ceb92fb678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.322248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f597df-12e9-4cab-a79e-8d3ab4bcbf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.322413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0b4e-6ef2-48e3-b932-f2ceb92fb678 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.322694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0b4e-6ef2-48e3-b932-f2ceb92fb678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.322974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0b4e-6ef2-48e3-b932-f2ceb92fb678 admin admin] PATH_INFO: `/v3/projects/ea17cc8d179a4592b31943bb2407f7f6/users/6d347b6fa79b48f193449a91c6ed8b48/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.323066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f597df-12e9-4cab-a79e-8d3ab4bcbf47 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.323264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f597df-12e9-4cab-a79e-8d3ab4bcbf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.323538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f597df-12e9-4cab-a79e-8d3ab4bcbf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.324208 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f597df-12e9-4cab-a79e-8d3ab4bcbf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.326897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f597df-12e9-4cab-a79e-8d3ab4bcbf47 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.337385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 999/2000] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:09.341575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f597df-12e9-4cab-a79e-8d3ab4bcbf47 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.342158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f0b4e-6ef2-48e3-b932-f2ceb92fb678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea17cc8d179a4592b31943bb2407f7f6, user_id=6d347b6fa79b48f193449a91c6ed8b48, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.345516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f0b4e-6ef2-48e3-b932-f2ceb92fb678 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.352861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f597df-12e9-4cab-a79e-8d3ab4bcbf47 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.359950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1002/2001] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:09 2022] PUT /identity/v3/projects/ea17cc8d179a4592b31943bb2407f7f6/users/6d347b6fa79b48f193449a91c6ed8b48/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:09.363883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f0b4e-6ef2-48e3-b932-f2ceb92fb678 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.416655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991e6df-fdf7-4d25-b263-8c31017a30ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.417350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991e6df-fdf7-4d25-b263-8c31017a30ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.417689 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991e6df-fdf7-4d25-b263-8c31017a30ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.418023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991e6df-fdf7-4d25-b263-8c31017a30ed admin admin] PATH_INFO: `/v3/projects/f2d287b74ddd418d80d235cf76b75d1d/users/6814bc870dfe4c8282840d45135861a9/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.437901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991e6df-fdf7-4d25-b263-8c31017a30ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d287b74ddd418d80d235cf76b75d1d, user_id=6814bc870dfe4c8282840d45135861a9, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.440467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f0b4e-6ef2-48e3-b932-f2ceb92fb678 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.440632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991e6df-fdf7-4d25-b263-8c31017a30ed admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.446257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3072e-89b7-4464-8fbb-7143bb9f2300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.447301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3072e-89b7-4464-8fbb-7143bb9f2300 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.447635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3072e-89b7-4464-8fbb-7143bb9f2300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.448121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3072e-89b7-4464-8fbb-7143bb9f2300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.448967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3072e-89b7-4464-8fbb-7143bb9f2300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.450694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3072e-89b7-4464-8fbb-7143bb9f2300 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.458561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1000/2002] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:09 2022] PUT /identity/v3/projects/f2d287b74ddd418d80d235cf76b75d1d/users/6814bc870dfe4c8282840d45135861a9/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:09.462792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991e6df-fdf7-4d25-b263-8c31017a30ed admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.467342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1003/2003] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:09.472185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3072e-89b7-4464-8fbb-7143bb9f2300 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.484850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3072e-89b7-4464-8fbb-7143bb9f2300 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.509708 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:09.540955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991e6df-fdf7-4d25-b263-8c31017a30ed admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.547074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f0dcf-2004-48a4-aa79-f8b38c170425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.548787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f0dcf-2004-48a4-aa79-f8b38c170425 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.549088 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f0dcf-2004-48a4-aa79-f8b38c170425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.549762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f0dcf-2004-48a4-aa79-f8b38c170425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.550061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f0dcf-2004-48a4-aa79-f8b38c170425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.551694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f0dcf-2004-48a4-aa79-f8b38c170425 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.564269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1001/2004] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:09.571498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f0dcf-2004-48a4-aa79-f8b38c170425 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.583578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f0dcf-2004-48a4-aa79-f8b38c170425 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.585102 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e758c-210b-4d90-affb-b01a9d226d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.585806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e758c-210b-4d90-affb-b01a9d226d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.586087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e758c-210b-4d90-affb-b01a9d226d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.586363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e758c-210b-4d90-affb-b01a9d226d27 admin admin] PATH_INFO: `/v3/projects/ea17cc8d179a4592b31943bb2407f7f6/users/6d347b6fa79b48f193449a91c6ed8b48/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.588242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e758c-210b-4d90-affb-b01a9d226d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea17cc8d179a4592b31943bb2407f7f6, user_id=6d347b6fa79b48f193449a91c6ed8b48, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.588955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42bd2b-83ae-4601-8e31-68a22785ef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.590325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42bd2b-83ae-4601-8e31-68a22785ef69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.590325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42bd2b-83ae-4601-8e31-68a22785ef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.590325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42bd2b-83ae-4601-8e31-68a22785ef69 admin admin] PATH_INFO: `/v3/projects/f2d287b74ddd418d80d235cf76b75d1d/users/6814bc870dfe4c8282840d45135861a9/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.590904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e758c-210b-4d90-affb-b01a9d226d27 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.603001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42bd2b-83ae-4601-8e31-68a22785ef69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d287b74ddd418d80d235cf76b75d1d, user_id=6814bc870dfe4c8282840d45135861a9, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.606237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42bd2b-83ae-4601-8e31-68a22785ef69 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.609732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1004/2005] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:09 2022] PUT /identity/v3/projects/ea17cc8d179a4592b31943bb2407f7f6/users/6d347b6fa79b48f193449a91c6ed8b48/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:09.619083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1002/2006] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:09 2022] PUT /identity/v3/projects/f2d287b74ddd418d80d235cf76b75d1d/users/6814bc870dfe4c8282840d45135861a9/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:09.621523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391886b6-2c56-44aa-ae0e-a0f708db55b8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.621856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391886b6-2c56-44aa-ae0e-a0f708db55b8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.622133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391886b6-2c56-44aa-ae0e-a0f708db55b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.630792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f1a0-bb0f-46df-8d2c-473a9aaa8cbc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.631087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f1a0-bb0f-46df-8d2c-473a9aaa8cbc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.631431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f1a0-bb0f-46df-8d2c-473a9aaa8cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.652684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-391886b6-2c56-44aa-ae0e-a0f708db55b8 None None] MFA Rules not processed for user `6d347b6fa79b48f193449a91c6ed8b48`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:09.654528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-391886b6-2c56-44aa-ae0e-a0f708db55b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:09.664987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e833f1a0-bb0f-46df-8d2c-473a9aaa8cbc None None] MFA Rules not processed for user `6814bc870dfe4c8282840d45135861a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:09.666372 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e833f1a0-bb0f-46df-8d2c-473a9aaa8cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:09.750930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:09.751552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1003/2007] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:09.766888 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1005/2008] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:09 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:09.768115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833f1a0-bb0f-46df-8d2c-473a9aaa8cbc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.769554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e833f1a0-bb0f-46df-8d2c-473a9aaa8cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:09.775018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391886b6-2c56-44aa-ae0e-a0f708db55b8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:09.777351 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-391886b6-2c56-44aa-ae0e-a0f708db55b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:09.865800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391886b6-2c56-44aa-ae0e-a0f708db55b8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.867428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833f1a0-bb0f-46df-8d2c-473a9aaa8cbc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:09.869897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5003e79-bd24-43ef-9d27-fa9b866f64d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.872019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5003e79-bd24-43ef-9d27-fa9b866f64d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.872317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5003e79-bd24-43ef-9d27-fa9b866f64d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.872598 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5003e79-bd24-43ef-9d27-fa9b866f64d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.872817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024e8d2-c334-46df-b0dd-0c3ab6dab004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:09.873678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024e8d2-c334-46df-b0dd-0c3ab6dab004 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:09.874098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024e8d2-c334-46df-b0dd-0c3ab6dab004 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:09.875409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024e8d2-c334-46df-b0dd-0c3ab6dab004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:09.884107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5003e79-bd24-43ef-9d27-fa9b866f64d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.885756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5003e79-bd24-43ef-9d27-fa9b866f64d9 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.888906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024e8d2-c334-46df-b0dd-0c3ab6dab004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:09.892897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024e8d2-c334-46df-b0dd-0c3ab6dab004 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:09.907413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1006/2009] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:09 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:09.920394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1004/2010] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:10.076320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5003e79-bd24-43ef-9d27-fa9b866f64d9 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:10.085482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5003e79-bd24-43ef-9d27-fa9b866f64d9 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:10.090584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcd86b-882a-4ee1-9e9d-e0ef8b12b116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:10.091199 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcd86b-882a-4ee1-9e9d-e0ef8b12b116 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:10.092049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcd86b-882a-4ee1-9e9d-e0ef8b12b116 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:10.092333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcd86b-882a-4ee1-9e9d-e0ef8b12b116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:10.152978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024e8d2-c334-46df-b0dd-0c3ab6dab004 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:10.162374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024e8d2-c334-46df-b0dd-0c3ab6dab004 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:10.162579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcd86b-882a-4ee1-9e9d-e0ef8b12b116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:10.164411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcd86b-882a-4ee1-9e9d-e0ef8b12b116 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:10.166171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53531b-722a-46c4-bd97-c54f60051ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:10.166771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53531b-722a-46c4-bd97-c54f60051ecd service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:10.167067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53531b-722a-46c4-bd97-c54f60051ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:10.167376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53531b-722a-46c4-bd97-c54f60051ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:10.176808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1007/2011] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:10.223392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:10.241596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53531b-722a-46c4-bd97-c54f60051ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:10.251649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53531b-722a-46c4-bd97-c54f60051ecd service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:10.262187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1005/2012] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:10 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:15.861180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcd86b-882a-4ee1-9e9d-e0ef8b12b116 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:15.944308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcd86b-882a-4ee1-9e9d-e0ef8b12b116 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:15.950755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:15.952870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:15.952870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:15.952870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] PATH_INFO: `/v3/users/d8547f3890b14334b28854697d645c0e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:15.954001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8547f3890b14334b28854697d645c0e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:15.956187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:16.026336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:16.035635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8547f3890b14334b28854697d645c0e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.044254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8547f3890b14334b28854697d645c0e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.044951 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8547f3890b14334b28854697d645c0e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.045571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8547f3890b14334b28854697d645c0e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.055266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8547f3890b14334b28854697d645c0e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.076416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1008/2013] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:15 2022] DELETE /identity/v3/users/d8547f3890b14334b28854697d645c0e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:16.081297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d71c8-30b1-460c-b812-6ec01480f6f7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:16.081817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d71c8-30b1-460c-b812-6ec01480f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:16.081956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d71c8-30b1-460c-b812-6ec01480f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:16.101588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-913d71c8-30b1-460c-b812-6ec01480f6f7 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:16.102822 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-913d71c8-30b1-460c-b812-6ec01480f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:16.173363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1006/2014] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:16.183960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:16.185749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:16.246451 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867e7a2-1743-4092-bf35-9181929b388f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:16.250699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9f4ef-49ff-499b-b911-293dcce9faf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:16.251344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9f4ef-49ff-499b-b911-293dcce9faf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:16.251623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9f4ef-49ff-499b-b911-293dcce9faf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:16.251894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9f4ef-49ff-499b-b911-293dcce9faf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:16.261884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9f4ef-49ff-499b-b911-293dcce9faf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:16.265647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9f4ef-49ff-499b-b911-293dcce9faf5 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:16.274256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1009/2015] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:16.658261 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d71c8-30b1-460c-b812-6ec01480f6f7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:16.659758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-913d71c8-30b1-460c-b812-6ec01480f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:16.675888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d71c8-30b1-460c-b812-6ec01480f6f7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:16.680256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:16.680894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:16.681176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:16.681450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] PATH_INFO: `/v3/projects/c70507357477475298ab79b29fb132c7` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:16.682678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70507357477475298ab79b29fb132c7)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:16.684587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:16.732123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70507357477475298ab79b29fb132c7', 'request_id': 'req-2c546110-5648-4d5f-a856-d5375f4e76b5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.738560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70507357477475298ab79b29fb132c7', 'request_id': 'req-2c546110-5648-4d5f-a856-d5375f4e76b5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.746248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70507357477475298ab79b29fb132c7', 'request_id': 'req-2c546110-5648-4d5f-a856-d5375f4e76b5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.758700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] The token cache is being invalidate because project c70507357477475298ab79b29fb132c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:16.758993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.759634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.761123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1007/2016] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:16 2022] DELETE /identity/v3/projects/c70507357477475298ab79b29fb132c7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:16.765572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9f4ef-49ff-499b-b911-293dcce9faf5 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:16.775130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9f4ef-49ff-499b-b911-293dcce9faf5 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:16.831683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:16.832324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:16.832607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:16.832883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] PATH_INFO: `/v3/users/6d347b6fa79b48f193449a91c6ed8b48` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:16.834025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d347b6fa79b48f193449a91c6ed8b48)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:16.835954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:16.885861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d347b6fa79b48f193449a91c6ed8b48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.894375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d347b6fa79b48f193449a91c6ed8b48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.895179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d347b6fa79b48f193449a91c6ed8b48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.895944 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d347b6fa79b48f193449a91c6ed8b48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.901698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:16.902254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:16.903762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d7f3df2f-e2fb-46a7-b5e1-2546488883e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d347b6fa79b48f193449a91c6ed8b48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.903898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:16.917428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c546110-5648-4d5f-a856-d5375f4e76b5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:16.922009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:16.922663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:16.922941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:16.923210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] PATH_INFO: `/v3/users/764c987fa7254055bbda88d90a65c571` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:16.923616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1010/2017] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:16 2022] DELETE /identity/v3/users/6d347b6fa79b48f193449a91c6ed8b48 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:16.927178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764c987fa7254055bbda88d90a65c571)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:16.929105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:16.979794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764c987fa7254055bbda88d90a65c571'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.987304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764c987fa7254055bbda88d90a65c571'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.988253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764c987fa7254055bbda88d90a65c571'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.989139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764c987fa7254055bbda88d90a65c571'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.996535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764c987fa7254055bbda88d90a65c571'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:16.997840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:17.019006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1008/2018] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:16 2022] DELETE /identity/v3/users/764c987fa7254055bbda88d90a65c571 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:17.023187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe9ae4-441b-47d0-8e42-96338d3aa35d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.023477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe9ae4-441b-47d0-8e42-96338d3aa35d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.023756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe9ae4-441b-47d0-8e42-96338d3aa35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.050664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c0fe9ae4-441b-47d0-8e42-96338d3aa35d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:17.051891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c0fe9ae4-441b-47d0-8e42-96338d3aa35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:17.126016 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1011/2019] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:17.135946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:17.137428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:17.223362 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe9ae4-441b-47d0-8e42-96338d3aa35d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:17.225463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c0fe9ae4-441b-47d0-8e42-96338d3aa35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:17.240199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcacc3a-2aaa-4a6a-a7b6-c139d86d8e69 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:17.247712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881264a-a3d3-4483-b4e9-b12b2fb0fc61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:17.248698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881264a-a3d3-4483-b4e9-b12b2fb0fc61 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.248836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881264a-a3d3-4483-b4e9-b12b2fb0fc61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.249714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881264a-a3d3-4483-b4e9-b12b2fb0fc61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.268512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe9ae4-441b-47d0-8e42-96338d3aa35d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:17.275284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:17.276239 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.276526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.276925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] PATH_INFO: `/v3/projects/ea17cc8d179a4592b31943bb2407f7f6` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.277809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881264a-a3d3-4483-b4e9-b12b2fb0fc61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:17.278093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea17cc8d179a4592b31943bb2407f7f6)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:17.280084 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:17.280469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881264a-a3d3-4483-b4e9-b12b2fb0fc61 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:17.291938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1009/2020] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:17.347280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea17cc8d179a4592b31943bb2407f7f6', 'request_id': 'req-2199c060-12cf-4c6e-8f6f-b86ce77688d2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:17.356586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea17cc8d179a4592b31943bb2407f7f6', 'request_id': 'req-2199c060-12cf-4c6e-8f6f-b86ce77688d2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:17.364466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea17cc8d179a4592b31943bb2407f7f6', 'request_id': 'req-2199c060-12cf-4c6e-8f6f-b86ce77688d2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:17.379905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] The token cache is being invalidate because project ea17cc8d179a4592b31943bb2407f7f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:17.380513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:17.383217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2199c060-12cf-4c6e-8f6f-b86ce77688d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:17.384779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1012/2021] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:17 2022] DELETE /identity/v3/projects/ea17cc8d179a4592b31943bb2407f7f6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:17.389455 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48390728-3178-4fa0-964e-8c83f031a115 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.390359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48390728-3178-4fa0-964e-8c83f031a115 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.390632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48390728-3178-4fa0-964e-8c83f031a115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.415791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-48390728-3178-4fa0-964e-8c83f031a115 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:17.417167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-48390728-3178-4fa0-964e-8c83f031a115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:17.501713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1010/2022] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:17.509766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e867fef-7f97-4ff6-9d43-769f5dbef784 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.510063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e867fef-7f97-4ff6-9d43-769f5dbef784 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.510341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e867fef-7f97-4ff6-9d43-769f5dbef784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.548001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6e867fef-7f97-4ff6-9d43-769f5dbef784 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:17.549446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6e867fef-7f97-4ff6-9d43-769f5dbef784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:17.569371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1013/2023] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:17.574008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48390728-3178-4fa0-964e-8c83f031a115 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:17.588809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48390728-3178-4fa0-964e-8c83f031a115 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:17.596906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639b46f-f2d2-4e26-96f3-588e6eec12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:17.597708 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b46f-f2d2-4e26-96f3-588e6eec12a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.598094 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b46f-f2d2-4e26-96f3-588e6eec12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.598632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b46f-f2d2-4e26-96f3-588e6eec12a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.599256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639b46f-f2d2-4e26-96f3-588e6eec12a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:17.599477 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639b46f-f2d2-4e26-96f3-588e6eec12a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:17.601172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639b46f-f2d2-4e26-96f3-588e6eec12a5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:17.616501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1011/2024] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:13:17.620956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e867fef-7f97-4ff6-9d43-769f5dbef784 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:17.630873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e867fef-7f97-4ff6-9d43-769f5dbef784 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:17.636034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e70ae6-84cd-490f-83ed-1c35c6d15f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:17.636605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70ae6-84cd-490f-83ed-1c35c6d15f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.636877 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70ae6-84cd-490f-83ed-1c35c6d15f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.637145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70ae6-84cd-490f-83ed-1c35c6d15f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.637811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e70ae6-84cd-490f-83ed-1c35c6d15f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:17.640438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e70ae6-84cd-490f-83ed-1c35c6d15f3c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:17.682805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1014/2025] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:17 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:17.686412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639b46f-f2d2-4e26-96f3-588e6eec12a5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:17.698905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639b46f-f2d2-4e26-96f3-588e6eec12a5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:17.755010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e70ae6-84cd-490f-83ed-1c35c6d15f3c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:17.756636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f7e70ae6-84cd-490f-83ed-1c35c6d15f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:17.780125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce9964-1115-45df-b95f-f7bd83add838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:17.781027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce9964-1115-45df-b95f-f7bd83add838 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.781492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce9964-1115-45df-b95f-f7bd83add838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.781971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce9964-1115-45df-b95f-f7bd83add838 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.782801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce9964-1115-45df-b95f-f7bd83add838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:17.785178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce9964-1115-45df-b95f-f7bd83add838 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:17.815911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:17.818807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:17.838315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1012/2026] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:17 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:17.842262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce9964-1115-45df-b95f-f7bd83add838 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:17.853178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e70ae6-84cd-490f-83ed-1c35c6d15f3c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:17.854514 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce9964-1115-45df-b95f-f7bd83add838 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:17.858870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:17.859632 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.860060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.860174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe73cea-903b-4b08-af3f-8597df58437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:17.860380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] PATH_INFO: `/v3/projects/0443dda926b44953b6596ec8c656ec95` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.860670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe73cea-903b-4b08-af3f-8597df58437d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.860984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe73cea-903b-4b08-af3f-8597df58437d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.861256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe73cea-903b-4b08-af3f-8597df58437d admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.861594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0443dda926b44953b6596ec8c656ec95)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:17.861937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe73cea-903b-4b08-af3f-8597df58437d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:17.863661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe73cea-903b-4b08-af3f-8597df58437d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:17.864489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:17.894779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1013/2027] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:17.897589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe73cea-903b-4b08-af3f-8597df58437d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:17.909526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe73cea-903b-4b08-af3f-8597df58437d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:17.914895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b969e8-3463-4449-8f1a-d4a66f2b1fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:17.915730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b969e8-3463-4449-8f1a-d4a66f2b1fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.916151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b969e8-3463-4449-8f1a-d4a66f2b1fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.916565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b969e8-3463-4449-8f1a-d4a66f2b1fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:17.917344 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b969e8-3463-4449-8f1a-d4a66f2b1fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:17.919289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b969e8-3463-4449-8f1a-d4a66f2b1fb6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:17.932480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1014/2028] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:17.934386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0443dda926b44953b6596ec8c656ec95', 'request_id': 'req-0fed01b3-fed8-4533-b9dd-e1a68df39d12'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:17.936498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b969e8-3463-4449-8f1a-d4a66f2b1fb6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:17.946093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0443dda926b44953b6596ec8c656ec95', 'request_id': 'req-0fed01b3-fed8-4533-b9dd-e1a68df39d12'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:17.950430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b969e8-3463-4449-8f1a-d4a66f2b1fb6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:17.953838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0443dda926b44953b6596ec8c656ec95', 'request_id': 'req-0fed01b3-fed8-4533-b9dd-e1a68df39d12'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:17.969000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] The token cache is being invalidate because project 0443dda926b44953b6596ec8c656ec95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:17.969453 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:17.970979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fed01b3-fed8-4533-b9dd-e1a68df39d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:17.972898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1015/2029] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:17 2022] DELETE /identity/v3/projects/0443dda926b44953b6596ec8c656ec95 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:17.978015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c800-a75d-4aba-bf37-a99c60fb8e52 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:17.978294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c800-a75d-4aba-bf37-a99c60fb8e52 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:17.978561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c800-a75d-4aba-bf37-a99c60fb8e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.002522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1466c800-a75d-4aba-bf37-a99c60fb8e52 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:18.003892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1466c800-a75d-4aba-bf37-a99c60fb8e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:18.024489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142d07c-8e95-4ef3-9f43-fe9598a7ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:18.025201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142d07c-8e95-4ef3-9f43-fe9598a7ddcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.025478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142d07c-8e95-4ef3-9f43-fe9598a7ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.025776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142d07c-8e95-4ef3-9f43-fe9598a7ddcb admin admin] PATH_INFO: `/v3/projects/59cf4bf7ad644defabc01c2656da2525/users/cc872238134a462f82d8b37383d86fdb/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.040359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142d07c-8e95-4ef3-9f43-fe9598a7ddcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cf4bf7ad644defabc01c2656da2525, user_id=cc872238134a462f82d8b37383d86fdb, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:18.043110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142d07c-8e95-4ef3-9f43-fe9598a7ddcb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:18.057057 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1015/2030] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:17 2022] PUT /identity/v3/projects/59cf4bf7ad644defabc01c2656da2525/users/cc872238134a462f82d8b37383d86fdb/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:18.068625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722512e-d3dd-4c25-af50-cd0342c65492 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.068904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722512e-d3dd-4c25-af50-cd0342c65492 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.069171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722512e-d3dd-4c25-af50-cd0342c65492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.073209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1016/2031] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:18.083142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee72b2c-ef4a-4101-a1e2-23d87ca27f57 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.083511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee72b2c-ef4a-4101-a1e2-23d87ca27f57 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.083803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee72b2c-ef4a-4101-a1e2-23d87ca27f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.097607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b722512e-d3dd-4c25-af50-cd0342c65492 None None] MFA Rules not processed for user `cc872238134a462f82d8b37383d86fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:18.098847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b722512e-d3dd-4c25-af50-cd0342c65492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:18.103808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5ee72b2c-ef4a-4101-a1e2-23d87ca27f57 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:18.104903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5ee72b2c-ef4a-4101-a1e2-23d87ca27f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:18.164949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1016/2032] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:18.166819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1017/2033] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:18.170656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722512e-d3dd-4c25-af50-cd0342c65492 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:18.177398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee72b2c-ef4a-4101-a1e2-23d87ca27f57 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:18.178773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5ee72b2c-ef4a-4101-a1e2-23d87ca27f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:18.181922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722512e-d3dd-4c25-af50-cd0342c65492 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:18.184944 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:18.187319 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469dc4e-c47e-40f5-81b5-df3cadfb4a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:18.188030 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469dc4e-c47e-40f5-81b5-df3cadfb4a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.188384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469dc4e-c47e-40f5-81b5-df3cadfb4a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.188683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469dc4e-c47e-40f5-81b5-df3cadfb4a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.189334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469dc4e-c47e-40f5-81b5-df3cadfb4a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:18.189663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469dc4e-c47e-40f5-81b5-df3cadfb4a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:18.191450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469dc4e-c47e-40f5-81b5-df3cadfb4a28 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:18.208344 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1017/2034] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:13:18.212536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469dc4e-c47e-40f5-81b5-df3cadfb4a28 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:18.222779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469dc4e-c47e-40f5-81b5-df3cadfb4a28 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:18.227897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8929-225b-4490-8a7a-d049a6934c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:18.228483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8929-225b-4490-8a7a-d049a6934c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.228763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8929-225b-4490-8a7a-d049a6934c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.229035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8929-225b-4490-8a7a-d049a6934c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.229696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8929-225b-4490-8a7a-d049a6934c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:18.231929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8929-225b-4490-8a7a-d049a6934c05 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:18.240157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee72b2c-ef4a-4101-a1e2-23d87ca27f57 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:18.244330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d6c2b-6dc9-4d37-8771-f6637a4d351b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:18.244973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d6c2b-6dc9-4d37-8771-f6637a4d351b service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.245256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d6c2b-6dc9-4d37-8771-f6637a4d351b service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.245527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d6c2b-6dc9-4d37-8771-f6637a4d351b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.255252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d6c2b-6dc9-4d37-8771-f6637a4d351b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:18.256896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d6c2b-6dc9-4d37-8771-f6637a4d351b service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:18.265242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1018/2035] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:18 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:18.266528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8929-225b-4490-8a7a-d049a6934c05 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:18.267457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1018/2036] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:18.284929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:18.290232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d6c2b-6dc9-4d37-8771-f6637a4d351b service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:18.291604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-025d6c2b-6dc9-4d37-8771-f6637a4d351b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:18.306193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d6c2b-6dc9-4d37-8771-f6637a4d351b service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:18.331767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8929-225b-4490-8a7a-d049a6934c05 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:18.336430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e07444-3769-418e-8232-04da8e0da9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:18.337059 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e07444-3769-418e-8232-04da8e0da9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.337341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e07444-3769-418e-8232-04da8e0da9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.337607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e07444-3769-418e-8232-04da8e0da9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.338259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e07444-3769-418e-8232-04da8e0da9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:18.340156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e07444-3769-418e-8232-04da8e0da9d6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:18.367642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1019/2037] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:18 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:18.367813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:18.367813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.367813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.367813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] PATH_INFO: `/v3/users/cc872238134a462f82d8b37383d86fdb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.368656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e07444-3769-418e-8232-04da8e0da9d6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:18.368950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc872238134a462f82d8b37383d86fdb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:18.370905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:18.378769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e07444-3769-418e-8232-04da8e0da9d6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:18.383462 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f0342-20f7-495e-9a9a-e35deedc961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:18.384150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f0342-20f7-495e-9a9a-e35deedc961e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.384434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f0342-20f7-495e-9a9a-e35deedc961e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.384705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f0342-20f7-495e-9a9a-e35deedc961e admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.385374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f0342-20f7-495e-9a9a-e35deedc961e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:18.386974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f0342-20f7-495e-9a9a-e35deedc961e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:18.397069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1020/2038] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:18.401774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f0342-20f7-495e-9a9a-e35deedc961e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:18.413501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f0342-20f7-495e-9a9a-e35deedc961e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:18.419179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8c91b-b780-4207-8872-88dcfa982a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:18.419749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc872238134a462f82d8b37383d86fdb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:18.419880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8c91b-b780-4207-8872-88dcfa982a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.420040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8c91b-b780-4207-8872-88dcfa982a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.420314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8c91b-b780-4207-8872-88dcfa982a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.421538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8c91b-b780-4207-8872-88dcfa982a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:18.423427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8c91b-b780-4207-8872-88dcfa982a91 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:18.428484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc872238134a462f82d8b37383d86fdb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:18.429127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc872238134a462f82d8b37383d86fdb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:18.430164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc872238134a462f82d8b37383d86fdb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:18.438343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-45015373-e4e2-4a24-91be-674d44d197b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc872238134a462f82d8b37383d86fdb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:18.438980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1021/2039] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:18.439767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8c91b-b780-4207-8872-88dcfa982a91 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:18.441675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8de8c91b-b780-4207-8872-88dcfa982a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:18.458648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8c91b-b780-4207-8872-88dcfa982a91 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:18.463710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b778de0-ddf5-4bc5-99a2-4fe1f8c11334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:18.467117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1019/2040] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:18 2022] DELETE /identity/v3/users/cc872238134a462f82d8b37383d86fdb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:18.467258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b778de0-ddf5-4bc5-99a2-4fe1f8c11334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.467258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b778de0-ddf5-4bc5-99a2-4fe1f8c11334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.467258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b778de0-ddf5-4bc5-99a2-4fe1f8c11334 admin admin] PATH_INFO: `/v3/projects/4dd433ed860b4fd38c612bc6167561a0/users/1d0cc5c8ab4445c2b2c6e97659502023/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.469076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f14d66-4785-406a-a024-18ce05153fdd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.469363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f14d66-4785-406a-a024-18ce05153fdd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.469658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f14d66-4785-406a-a024-18ce05153fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.487210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b778de0-ddf5-4bc5-99a2-4fe1f8c11334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd433ed860b4fd38c612bc6167561a0, user_id=1d0cc5c8ab4445c2b2c6e97659502023, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:18.489039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-89f14d66-4785-406a-a024-18ce05153fdd None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:18.490204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b778de0-ddf5-4bc5-99a2-4fe1f8c11334 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:18.490324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-89f14d66-4785-406a-a024-18ce05153fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:18.517159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:18.521917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1022/2041] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:18 2022] PUT /identity/v3/projects/4dd433ed860b4fd38c612bc6167561a0/users/1d0cc5c8ab4445c2b2c6e97659502023/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:18.526893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de70f9c-a964-44d5-87ee-8673fd663d51 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.527182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de70f9c-a964-44d5-87ee-8673fd663d51 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.527641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de70f9c-a964-44d5-87ee-8673fd663d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.564371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1020/2042] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:18.573559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6de70f9c-a964-44d5-87ee-8673fd663d51 None None] MFA Rules not processed for user `1d0cc5c8ab4445c2b2c6e97659502023`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:18.574907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6de70f9c-a964-44d5-87ee-8673fd663d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:18.577334 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f14d66-4785-406a-a024-18ce05153fdd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:18.578890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-89f14d66-4785-406a-a024-18ce05153fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:18.655141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f14d66-4785-406a-a024-18ce05153fdd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:18.674024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1023/2043] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:18.729736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8e708-0948-4448-8eb4-cd60f6eaa375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:18.730636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e708-0948-4448-8eb4-cd60f6eaa375 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:18.730912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e708-0948-4448-8eb4-cd60f6eaa375 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:18.731178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e708-0948-4448-8eb4-cd60f6eaa375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:18.800988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8e708-0948-4448-8eb4-cd60f6eaa375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:18.802575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8e708-0948-4448-8eb4-cd60f6eaa375 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:18.815037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1021/2044] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:18.952899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de70f9c-a964-44d5-87ee-8673fd663d51 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:18.952899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6de70f9c-a964-44d5-87ee-8673fd663d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:19.076347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:19.085147 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de70f9c-a964-44d5-87ee-8673fd663d51 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:19.090567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d9b9a-0174-4850-8e4c-9011ba6fdefe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:19.091298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d9b9a-0174-4850-8e4c-9011ba6fdefe service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:19.091683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d9b9a-0174-4850-8e4c-9011ba6fdefe service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:19.092566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d9b9a-0174-4850-8e4c-9011ba6fdefe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:19.104106 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d9b9a-0174-4850-8e4c-9011ba6fdefe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:19.106027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d9b9a-0174-4850-8e4c-9011ba6fdefe service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:19.138789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1024/2045] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:19.394263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8e708-0948-4448-8eb4-cd60f6eaa375 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:19.396036 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e5e8e708-0948-4448-8eb4-cd60f6eaa375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:19.416334 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8e708-0948-4448-8eb4-cd60f6eaa375 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:19.425884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:19.427409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:19.427777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:19.429101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] PATH_INFO: `/v3/projects/59cf4bf7ad644defabc01c2656da2525` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:19.431010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cf4bf7ad644defabc01c2656da2525)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:19.445564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:19.513444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:19.534928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cf4bf7ad644defabc01c2656da2525', 'request_id': 'req-01ef73bf-c9c1-493f-a92e-c874f60f0016'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:19.545282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cf4bf7ad644defabc01c2656da2525', 'request_id': 'req-01ef73bf-c9c1-493f-a92e-c874f60f0016'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:19.552592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cf4bf7ad644defabc01c2656da2525', 'request_id': 'req-01ef73bf-c9c1-493f-a92e-c874f60f0016'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:19.565241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] The token cache is being invalidate because project 59cf4bf7ad644defabc01c2656da2525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:19.565640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:19.566399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-01ef73bf-c9c1-493f-a92e-c874f60f0016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:19.567942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1022/2046] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:19 2022] DELETE /identity/v3/projects/59cf4bf7ad644defabc01c2656da2525 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:19.574287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fbc24-0c3b-436e-8c52-70619d977628 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:19.575265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fbc24-0c3b-436e-8c52-70619d977628 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:19.575894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fbc24-0c3b-436e-8c52-70619d977628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:19.598435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6c5fbc24-0c3b-436e-8c52-70619d977628 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:19.599654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6c5fbc24-0c3b-436e-8c52-70619d977628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:19.663530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1025/2047] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:19.671173 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887b67c-5fad-41ab-836d-688df3916b9b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:19.671765 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887b67c-5fad-41ab-836d-688df3916b9b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:19.672148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887b67c-5fad-41ab-836d-688df3916b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:19.693892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e887b67c-5fad-41ab-836d-688df3916b9b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:19.695232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e887b67c-5fad-41ab-836d-688df3916b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:19.703918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1023/2048] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:19.708274 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fbc24-0c3b-436e-8c52-70619d977628 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:19.720154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fbc24-0c3b-436e-8c52-70619d977628 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:19.724808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca612e-2131-4979-8007-0783055e2b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:19.725541 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca612e-2131-4979-8007-0783055e2b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:19.725880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca612e-2131-4979-8007-0783055e2b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:19.726281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca612e-2131-4979-8007-0783055e2b47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:19.726938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca612e-2131-4979-8007-0783055e2b47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:19.727243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca612e-2131-4979-8007-0783055e2b47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:19.728919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca612e-2131-4979-8007-0783055e2b47 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:19.742175 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1026/2049] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:13:19.746692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887b67c-5fad-41ab-836d-688df3916b9b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:19.757194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887b67c-5fad-41ab-836d-688df3916b9b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:19.762381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798fd6c-9639-4768-8ba1-180c11f65bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:19.762666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798fd6c-9639-4768-8ba1-180c11f65bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:19.763159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798fd6c-9639-4768-8ba1-180c11f65bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:19.763439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798fd6c-9639-4768-8ba1-180c11f65bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:19.764359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798fd6c-9639-4768-8ba1-180c11f65bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:19.767018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798fd6c-9639-4768-8ba1-180c11f65bdb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:19.799818 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1024/2050] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:19 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:19.801799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca612e-2131-4979-8007-0783055e2b47 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:19.812621 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca612e-2131-4979-8007-0783055e2b47 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:19.876919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924e0e0-eb64-4812-a9ad-dbee3038a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:19.877553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924e0e0-eb64-4812-a9ad-dbee3038a87a admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:19.877874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924e0e0-eb64-4812-a9ad-dbee3038a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:19.878132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924e0e0-eb64-4812-a9ad-dbee3038a87a admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:19.878765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924e0e0-eb64-4812-a9ad-dbee3038a87a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:19.880652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924e0e0-eb64-4812-a9ad-dbee3038a87a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:19.902270 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1027/2051] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:19 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:19.907189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798fd6c-9639-4768-8ba1-180c11f65bdb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:19.917733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798fd6c-9639-4768-8ba1-180c11f65bdb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:19.922923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56922111-cfb9-4897-8456-44782388c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:19.923521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56922111-cfb9-4897-8456-44782388c24a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:19.923800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56922111-cfb9-4897-8456-44782388c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:19.924070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56922111-cfb9-4897-8456-44782388c24a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:19.924708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56922111-cfb9-4897-8456-44782388c24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:19.926329 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56922111-cfb9-4897-8456-44782388c24a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:19.937470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1025/2052] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:19.941846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924e0e0-eb64-4812-a9ad-dbee3038a87a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:19.953366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924e0e0-eb64-4812-a9ad-dbee3038a87a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:19.958683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a267-0d7d-4fc3-b9af-d6f9846e1c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:19.959402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a267-0d7d-4fc3-b9af-d6f9846e1c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:19.959718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a267-0d7d-4fc3-b9af-d6f9846e1c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:19.960108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a267-0d7d-4fc3-b9af-d6f9846e1c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:19.960761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0a267-0d7d-4fc3-b9af-d6f9846e1c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:19.962406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0a267-0d7d-4fc3-b9af-d6f9846e1c8a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:19.974316 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1028/2053] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:19.978833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56922111-cfb9-4897-8456-44782388c24a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:19.993042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56922111-cfb9-4897-8456-44782388c24a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:19.999976 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4800af7-f9a9-4866-b984-1bb43a111206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:20.001260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800af7-f9a9-4866-b984-1bb43a111206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:20.001260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800af7-f9a9-4866-b984-1bb43a111206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:20.001456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800af7-f9a9-4866-b984-1bb43a111206 admin admin] PATH_INFO: `/v3/projects/bcc09f5d109843d09e59bf6c87c847cc/users/aa60a21a40da4e16bd394e725092fbd0/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:20.024293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4800af7-f9a9-4866-b984-1bb43a111206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc09f5d109843d09e59bf6c87c847cc, user_id=aa60a21a40da4e16bd394e725092fbd0, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:20.027245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4800af7-f9a9-4866-b984-1bb43a111206 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:20.061785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1026/2054] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:19 2022] PUT /identity/v3/projects/bcc09f5d109843d09e59bf6c87c847cc/users/aa60a21a40da4e16bd394e725092fbd0/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:20.063960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf546e-31f5-464b-9ab2-e75eba5be15e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:20.064245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf546e-31f5-464b-9ab2-e75eba5be15e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:20.064519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf546e-31f5-464b-9ab2-e75eba5be15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:20.104160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d2cf546e-31f5-464b-9ab2-e75eba5be15e None None] MFA Rules not processed for user `aa60a21a40da4e16bd394e725092fbd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:20.106007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d2cf546e-31f5-464b-9ab2-e75eba5be15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:20.166614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:20.195304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1029/2055] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:20.208436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4800af7-f9a9-4866-b984-1bb43a111206 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:20.210611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d4800af7-f9a9-4866-b984-1bb43a111206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:20.286229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4800af7-f9a9-4866-b984-1bb43a111206 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:20.297770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afaf10-c8fe-4e2e-b499-034fcc350f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:20.298775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afaf10-c8fe-4e2e-b499-034fcc350f4d service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:20.299096 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afaf10-c8fe-4e2e-b499-034fcc350f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:20.299360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afaf10-c8fe-4e2e-b499-034fcc350f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:20.310689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afaf10-c8fe-4e2e-b499-034fcc350f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:20.312755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afaf10-c8fe-4e2e-b499-034fcc350f4d service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:20.327459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1027/2056] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:21.615812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf546e-31f5-464b-9ab2-e75eba5be15e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:21.637449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf546e-31f5-464b-9ab2-e75eba5be15e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:21.684414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a380c-b1f2-413a-b807-c18725d6f89c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:21.685033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a380c-b1f2-413a-b807-c18725d6f89c service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:21.685306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a380c-b1f2-413a-b807-c18725d6f89c service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:21.685573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a380c-b1f2-413a-b807-c18725d6f89c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:21.691756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c94a380c-b1f2-413a-b807-c18725d6f89c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:21.800982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a380c-b1f2-413a-b807-c18725d6f89c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:21.803105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a380c-b1f2-413a-b807-c18725d6f89c service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:21.821754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1030/2057] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:25.548370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afaf10-c8fe-4e2e-b499-034fcc350f4d service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:25.693934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:25.711870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afaf10-c8fe-4e2e-b499-034fcc350f4d service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:25.736088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:25.736327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:25.736564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:25.737949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] PATH_INFO: `/v3/users/aa60a21a40da4e16bd394e725092fbd0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:25.739129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa60a21a40da4e16bd394e725092fbd0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:25.741492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:25.857775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa60a21a40da4e16bd394e725092fbd0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:25.877962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa60a21a40da4e16bd394e725092fbd0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:25.878912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa60a21a40da4e16bd394e725092fbd0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:25.880423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa60a21a40da4e16bd394e725092fbd0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:25.891502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa60a21a40da4e16bd394e725092fbd0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:25.919892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1028/2058] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:25 2022] DELETE /identity/v3/users/aa60a21a40da4e16bd394e725092fbd0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:25.924930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a65d-acc6-44c8-8eec-f65ef19c9ee4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:25.925423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a65d-acc6-44c8-8eec-f65ef19c9ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:25.925502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a65d-acc6-44c8-8eec-f65ef19c9ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:25.946632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c0e5a65d-acc6-44c8-8eec-f65ef19c9ee4 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:25.949487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c0e5a65d-acc6-44c8-8eec-f65ef19c9ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:26.055638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1031/2059] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:26.066176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:26.067687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:26.138839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d08b8a-7a25-4bf7-953c-3437ede66830 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:26.143387 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785aa11-6c76-4f48-967c-a46b8dd8e523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:26.144023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785aa11-6c76-4f48-967c-a46b8dd8e523 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:26.144376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785aa11-6c76-4f48-967c-a46b8dd8e523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:26.144739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785aa11-6c76-4f48-967c-a46b8dd8e523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:26.157066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785aa11-6c76-4f48-967c-a46b8dd8e523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:26.159430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785aa11-6c76-4f48-967c-a46b8dd8e523 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:26.171708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1029/2060] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:26.645150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5a65d-acc6-44c8-8eec-f65ef19c9ee4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:26.647208 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c0e5a65d-acc6-44c8-8eec-f65ef19c9ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:26.676710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5a65d-acc6-44c8-8eec-f65ef19c9ee4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:26.690679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:26.691984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:26.692585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:26.693613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] PATH_INFO: `/v3/projects/bcc09f5d109843d09e59bf6c87c847cc` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:26.695465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc09f5d109843d09e59bf6c87c847cc)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:26.697799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:26.770777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc09f5d109843d09e59bf6c87c847cc', 'request_id': 'req-d73cd24d-95dd-4a07-b183-9d65253db27d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:26.779068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc09f5d109843d09e59bf6c87c847cc', 'request_id': 'req-d73cd24d-95dd-4a07-b183-9d65253db27d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:26.792031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc09f5d109843d09e59bf6c87c847cc', 'request_id': 'req-d73cd24d-95dd-4a07-b183-9d65253db27d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:26.809972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] The token cache is being invalidate because project bcc09f5d109843d09e59bf6c87c847cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:26.810681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:26.812120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d73cd24d-95dd-4a07-b183-9d65253db27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:26.814121 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1032/2061] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:26 2022] DELETE /identity/v3/projects/bcc09f5d109843d09e59bf6c87c847cc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:26.819525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb175e-e7ab-40d7-9202-b9ff411f21af None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:26.820505 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb175e-e7ab-40d7-9202-b9ff411f21af None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:26.820983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb175e-e7ab-40d7-9202-b9ff411f21af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:26.848720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d5cb175e-e7ab-40d7-9202-b9ff411f21af None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:26.850744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d5cb175e-e7ab-40d7-9202-b9ff411f21af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:26.920562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1030/2062] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:26.929246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e109d59-1534-4260-8cbd-7557650bf9ed None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:26.929773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e109d59-1534-4260-8cbd-7557650bf9ed None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:26.929882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e109d59-1534-4260-8cbd-7557650bf9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:26.939768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:26.954717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6e109d59-1534-4260-8cbd-7557650bf9ed None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:26.957038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e109d59-1534-4260-8cbd-7557650bf9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:26.966113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1033/2063] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:26.971232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb175e-e7ab-40d7-9202-b9ff411f21af None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:26.981195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb175e-e7ab-40d7-9202-b9ff411f21af None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:26.986543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25f75d-2623-4982-8d51-e4c5614c52a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:26.987149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25f75d-2623-4982-8d51-e4c5614c52a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:26.987432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25f75d-2623-4982-8d51-e4c5614c52a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:26.987706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25f75d-2623-4982-8d51-e4c5614c52a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:26.988358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25f75d-2623-4982-8d51-e4c5614c52a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:26.988662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25f75d-2623-4982-8d51-e4c5614c52a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:26.990283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25f75d-2623-4982-8d51-e4c5614c52a8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:27.002108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1031/2064] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:13:27.006668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e109d59-1534-4260-8cbd-7557650bf9ed None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:27.017423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e109d59-1534-4260-8cbd-7557650bf9ed None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:27.022169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176d805-644a-47a4-b162-b8c069033d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:27.022833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176d805-644a-47a4-b162-b8c069033d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:27.023179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176d805-644a-47a4-b162-b8c069033d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:27.023565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176d805-644a-47a4-b162-b8c069033d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:27.024282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176d805-644a-47a4-b162-b8c069033d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:27.026374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176d805-644a-47a4-b162-b8c069033d3a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:27.059760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1034/2065] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:27 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:27.060855 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25f75d-2623-4982-8d51-e4c5614c52a8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:27.067449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:27.071681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25f75d-2623-4982-8d51-e4c5614c52a8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:27.147808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb4034-240a-449a-a41a-0d2e88682265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:27.148593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb4034-240a-449a-a41a-0d2e88682265 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:27.148880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb4034-240a-449a-a41a-0d2e88682265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:27.149151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb4034-240a-449a-a41a-0d2e88682265 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:27.149828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb4034-240a-449a-a41a-0d2e88682265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:27.151827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb4034-240a-449a-a41a-0d2e88682265 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:27.181466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1032/2066] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:27 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:27.185652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176d805-644a-47a4-b162-b8c069033d3a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:27.207712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176d805-644a-47a4-b162-b8c069033d3a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:27.221266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bd776-2f9a-402e-a9ad-6d2046d4485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:27.222126 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bd776-2f9a-402e-a9ad-6d2046d4485b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:27.222519 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bd776-2f9a-402e-a9ad-6d2046d4485b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:27.222859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bd776-2f9a-402e-a9ad-6d2046d4485b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:27.223638 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bd776-2f9a-402e-a9ad-6d2046d4485b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:27.225555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bd776-2f9a-402e-a9ad-6d2046d4485b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:27.239643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1035/2067] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:27.245007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb4034-240a-449a-a41a-0d2e88682265 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:27.262263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb4034-240a-449a-a41a-0d2e88682265 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:27.268386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea8cab-df48-41d8-a425-4fb9b8dd16a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:27.269089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea8cab-df48-41d8-a425-4fb9b8dd16a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:27.269455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea8cab-df48-41d8-a425-4fb9b8dd16a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:27.269832 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea8cab-df48-41d8-a425-4fb9b8dd16a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:27.270547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea8cab-df48-41d8-a425-4fb9b8dd16a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:27.272357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea8cab-df48-41d8-a425-4fb9b8dd16a0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:27.284577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1033/2068] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:27.292539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bd776-2f9a-402e-a9ad-6d2046d4485b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:27.315212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bd776-2f9a-402e-a9ad-6d2046d4485b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:27.325203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aea834-db22-4842-a398-78e5661e9964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:27.325910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aea834-db22-4842-a398-78e5661e9964 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:27.326191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aea834-db22-4842-a398-78e5661e9964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:27.326467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aea834-db22-4842-a398-78e5661e9964 admin admin] PATH_INFO: `/v3/projects/84119b21feab40a3994de11471beace3/users/cd2edb3eefa5428e97b4742d70f719b9/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:27.363040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aea834-db22-4842-a398-78e5661e9964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84119b21feab40a3994de11471beace3, user_id=cd2edb3eefa5428e97b4742d70f719b9, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:27.366548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aea834-db22-4842-a398-78e5661e9964 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:27.423135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1036/2069] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:27 2022] PUT /identity/v3/projects/84119b21feab40a3994de11471beace3/users/cd2edb3eefa5428e97b4742d70f719b9/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:27.430115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe8db7-2c4f-4bd5-9aea-4bc7e1a7c106 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:27.430722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe8db7-2c4f-4bd5-9aea-4bc7e1a7c106 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:27.431351 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe8db7-2c4f-4bd5-9aea-4bc7e1a7c106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:27.470151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-53fe8db7-2c4f-4bd5-9aea-4bc7e1a7c106 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:27.471491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-53fe8db7-2c4f-4bd5-9aea-4bc7e1a7c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:27.537602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aea834-db22-4842-a398-78e5661e9964 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:27.539358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-43aea834-db22-4842-a398-78e5661e9964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:27.611591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1034/2070] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:27.637672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe8db7-2c4f-4bd5-9aea-4bc7e1a7c106 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:27.649265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-53fe8db7-2c4f-4bd5-9aea-4bc7e1a7c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:27.794362 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aea834-db22-4842-a398-78e5661e9964 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:27.806427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:27.807522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:27.808008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:27.808634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] PATH_INFO: `/v3/users/70fd71730f85489691510092141f3c0b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:27.810854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fd71730f85489691510092141f3c0b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:27.831669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:27.871164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe8db7-2c4f-4bd5-9aea-4bc7e1a7c106 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:27.881779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86248b-3a80-459d-a016-59164d9b38b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:27.882615 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86248b-3a80-459d-a016-59164d9b38b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:27.882973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86248b-3a80-459d-a016-59164d9b38b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:27.885066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86248b-3a80-459d-a016-59164d9b38b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:27.910122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86248b-3a80-459d-a016-59164d9b38b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:27.913318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86248b-3a80-459d-a016-59164d9b38b1 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:27.952440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1035/2071] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:27.972686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fd71730f85489691510092141f3c0b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:27.994978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fd71730f85489691510092141f3c0b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:27.995942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fd71730f85489691510092141f3c0b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:27.997077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fd71730f85489691510092141f3c0b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:28.018291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fd71730f85489691510092141f3c0b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:28.051259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1037/2072] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:27 2022] DELETE /identity/v3/users/70fd71730f85489691510092141f3c0b => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:28.058119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0e08-cccf-44e0-9adf-0402f446388d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:28.058589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0e08-cccf-44e0-9adf-0402f446388d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:28.058999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0e08-cccf-44e0-9adf-0402f446388d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:28.091920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-af8a0e08-cccf-44e0-9adf-0402f446388d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:28.094661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-af8a0e08-cccf-44e0-9adf-0402f446388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:28.143689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:28.227408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1036/2073] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:28.260561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:28.263107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:28.312133 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:28.391587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47716e5e-d4e8-41c7-a18a-9e6be72bce85 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:28.396601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e3326-87c1-4160-b846-04a114e5e259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:28.397328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e3326-87c1-4160-b846-04a114e5e259 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:28.397610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e3326-87c1-4160-b846-04a114e5e259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:28.398014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e3326-87c1-4160-b846-04a114e5e259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:28.410930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e3326-87c1-4160-b846-04a114e5e259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:28.412391 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e3326-87c1-4160-b846-04a114e5e259 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:28.440779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1038/2074] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:28.737229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f0368-aeae-431d-adfb-8bec2338c84b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:28.737822 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f0368-aeae-431d-adfb-8bec2338c84b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:28.738438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f0368-aeae-431d-adfb-8bec2338c84b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:28.740442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1037/2075] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:13:28.751581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0662a99-7cc8-4eb7-a3bb-4de929f06211 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:28.752118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0662a99-7cc8-4eb7-a3bb-4de929f06211 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:28.752433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0662a99-7cc8-4eb7-a3bb-4de929f06211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:28.777032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a0662a99-7cc8-4eb7-a3bb-4de929f06211 None None] MFA Rules not processed for user `1aded088aa2a40e4b7fe024647ebfbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:28.778635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a0662a99-7cc8-4eb7-a3bb-4de929f06211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:28.843003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f0368-aeae-431d-adfb-8bec2338c84b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:28.845788 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-352f0368-aeae-431d-adfb-8bec2338c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:28.872911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1039/2076] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:13:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:28.874991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f0368-aeae-431d-adfb-8bec2338c84b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:28.880461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:28.881114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:28.881390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:28.881872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] PATH_INFO: `/v3/users/106695be3b344f0bb2072112b0893f8c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:28.888680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106695be3b344f0bb2072112b0893f8c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:28.891768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25f6e9-21db-45b9-85df-aace8f72afc3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:28.892216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25f6e9-21db-45b9-85df-aace8f72afc3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:28.892816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:28.893741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25f6e9-21db-45b9-85df-aace8f72afc3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:28.898835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1040/2077] 10.222.0.50 () {54 vars in 961 bytes} [Mon Sep 19 12:13:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:13:28.905597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb142bd-2569-437d-9973-bf53f94e1a63 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:28.907128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb142bd-2569-437d-9973-bf53f94e1a63 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:28.907621 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb142bd-2569-437d-9973-bf53f94e1a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:28.944197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ecb142bd-2569-437d-9973-bf53f94e1a63 None None] MFA Rules not processed for user `1aded088aa2a40e4b7fe024647ebfbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:28.948157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ecb142bd-2569-437d-9973-bf53f94e1a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:28.973448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1041/2078] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Sep 19 12:13:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:28.991626 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb142bd-2569-437d-9973-bf53f94e1a63 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:29.015945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106695be3b344f0bb2072112b0893f8c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:29.019885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb142bd-2569-437d-9973-bf53f94e1a63 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:29.030368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84a66c-fcee-4d6c-94b9-7b480dc1ac51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:29.031564 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a66c-fcee-4d6c-94b9-7b480dc1ac51 service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:29.031889 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a66c-fcee-4d6c-94b9-7b480dc1ac51 service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:29.032172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a66c-fcee-4d6c-94b9-7b480dc1ac51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:29.041537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106695be3b344f0bb2072112b0893f8c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:29.042247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106695be3b344f0bb2072112b0893f8c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:29.042915 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106695be3b344f0bb2072112b0893f8c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:29.050737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84a66c-fcee-4d6c-94b9-7b480dc1ac51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:29.054536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84a66c-fcee-4d6c-94b9-7b480dc1ac51 service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:29.055144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106695be3b344f0bb2072112b0893f8c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:29.093569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1042/2079] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:29.119762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1038/2080] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:28 2022] DELETE /identity/v3/users/106695be3b344f0bb2072112b0893f8c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:29.521710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84a66c-fcee-4d6c-94b9-7b480dc1ac51 service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:29.523429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9f84a66c-fcee-4d6c-94b9-7b480dc1ac51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:29.561490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84a66c-fcee-4d6c-94b9-7b480dc1ac51 service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:29.645899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:29.646595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:29.647249 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:29.647540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] PATH_INFO: `/v3/projects/b09c039697184665b55409474432eba5` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:29.649374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09c039697184665b55409474432eba5)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:29.652138 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:29.714224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:29.725051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09c039697184665b55409474432eba5', 'request_id': 'req-fe3a163d-7abd-498f-bafb-ccfce6369bdb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:29.732888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09c039697184665b55409474432eba5', 'request_id': 'req-fe3a163d-7abd-498f-bafb-ccfce6369bdb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:29.748614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09c039697184665b55409474432eba5', 'request_id': 'req-fe3a163d-7abd-498f-bafb-ccfce6369bdb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:29.773794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] The token cache is being invalidate because project b09c039697184665b55409474432eba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:29.774096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:29.774778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:29.777973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1043/2081] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:29 2022] DELETE /identity/v3/projects/b09c039697184665b55409474432eba5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:29.782568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:29.783731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:29.804022 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba78df-0407-495e-ba78-164f228a0140 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:29.917479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:29.918341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:29.918708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:29.919188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] PATH_INFO: `/v3/users/6814bc870dfe4c8282840d45135861a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:29.920996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6814bc870dfe4c8282840d45135861a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:29.923207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:29.930465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:29.934941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:29.974405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a163d-7abd-498f-bafb-ccfce6369bdb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:29.984141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:29.985017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:29.985305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:29.985580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] PATH_INFO: `/v3/projects/fdc9177a85454986b3d85c2662f4865c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:29.987584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc9177a85454986b3d85c2662f4865c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:29.992698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:30.036795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:30.058314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6814bc870dfe4c8282840d45135861a9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.080242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6814bc870dfe4c8282840d45135861a9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.081876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6814bc870dfe4c8282840d45135861a9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.082512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6814bc870dfe4c8282840d45135861a9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.100736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-032c947f-5b56-405e-bbf9-728c1a88fc08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6814bc870dfe4c8282840d45135861a9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.124923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc9177a85454986b3d85c2662f4865c', 'request_id': 'req-569f5291-a69b-45d2-adf3-929e651af6f2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.147436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1039/2082] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:29 2022] DELETE /identity/v3/users/6814bc870dfe4c8282840d45135861a9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:30.158100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc9177a85454986b3d85c2662f4865c', 'request_id': 'req-569f5291-a69b-45d2-adf3-929e651af6f2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.178056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc9177a85454986b3d85c2662f4865c', 'request_id': 'req-569f5291-a69b-45d2-adf3-929e651af6f2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.206728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] The token cache is being invalidate because project fdc9177a85454986b3d85c2662f4865c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:30.208776 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.210009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-569f5291-a69b-45d2-adf3-929e651af6f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.213830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1044/2083] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:29 2022] DELETE /identity/v3/projects/fdc9177a85454986b3d85c2662f4865c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:30.222741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3138975-b17f-4676-aaa0-686a94bbbbf9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:30.223343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3138975-b17f-4676-aaa0-686a94bbbbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:30.224324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3138975-b17f-4676-aaa0-686a94bbbbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:30.265572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c3138975-b17f-4676-aaa0-686a94bbbbf9 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:30.267066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c3138975-b17f-4676-aaa0-686a94bbbbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:30.447829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1040/2084] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:30.449885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3b96-da14-4d28-94a1-c95ca7ec3db0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:30.450183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3b96-da14-4d28-94a1-c95ca7ec3db0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:30.450464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3b96-da14-4d28-94a1-c95ca7ec3db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:30.476127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fe8b3b96-da14-4d28-94a1-c95ca7ec3db0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:30.477730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fe8b3b96-da14-4d28-94a1-c95ca7ec3db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:30.488422 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1045/2085] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:30.493349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3138975-b17f-4676-aaa0-686a94bbbbf9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:30.505449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3138975-b17f-4676-aaa0-686a94bbbbf9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:30.515330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e19ff6-45b5-49da-bee3-237c12055e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:30.517310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19ff6-45b5-49da-bee3-237c12055e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:30.517771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19ff6-45b5-49da-bee3-237c12055e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:30.518166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19ff6-45b5-49da-bee3-237c12055e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:30.518945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e19ff6-45b5-49da-bee3-237c12055e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:30.519375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e19ff6-45b5-49da-bee3-237c12055e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:30.524517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e19ff6-45b5-49da-bee3-237c12055e88 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:30.567120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1041/2086] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:13:30.568222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b3b96-da14-4d28-94a1-c95ca7ec3db0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:30.593200 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b3b96-da14-4d28-94a1-c95ca7ec3db0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:30.601267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e19ff6-45b5-49da-bee3-237c12055e88 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:30.603240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-85e19ff6-45b5-49da-bee3-237c12055e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:30.606486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42254eaa-38dc-4275-a929-09bf1990d105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:30.607244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42254eaa-38dc-4275-a929-09bf1990d105 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:30.607725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42254eaa-38dc-4275-a929-09bf1990d105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:30.609778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42254eaa-38dc-4275-a929-09bf1990d105 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:30.610563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42254eaa-38dc-4275-a929-09bf1990d105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:30.615950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42254eaa-38dc-4275-a929-09bf1990d105 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:30.624528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e19ff6-45b5-49da-bee3-237c12055e88 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:30.636457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:30.637156 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:30.637438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:30.637732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] PATH_INFO: `/v3/projects/f2d287b74ddd418d80d235cf76b75d1d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:30.641009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d287b74ddd418d80d235cf76b75d1d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:30.644161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:30.683346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1046/2087] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:30 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:30.688843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42254eaa-38dc-4275-a929-09bf1990d105 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:30.729444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d287b74ddd418d80d235cf76b75d1d', 'request_id': 'req-e8db0d8f-f3b5-46cf-83b3-66f15903a432'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.741396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d287b74ddd418d80d235cf76b75d1d', 'request_id': 'req-e8db0d8f-f3b5-46cf-83b3-66f15903a432'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.750587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d287b74ddd418d80d235cf76b75d1d', 'request_id': 'req-e8db0d8f-f3b5-46cf-83b3-66f15903a432'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.770079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] The token cache is being invalidate because project f2d287b74ddd418d80d235cf76b75d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:30.770361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.771582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e8db0d8f-f3b5-46cf-83b3-66f15903a432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:30.775866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1042/2088] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:30 2022] DELETE /identity/v3/projects/f2d287b74ddd418d80d235cf76b75d1d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:30.782551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6924e5-8470-4a23-9429-4170e9a639ee None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:30.782835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6924e5-8470-4a23-9429-4170e9a639ee None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:30.783114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6924e5-8470-4a23-9429-4170e9a639ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:30.797389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42254eaa-38dc-4275-a929-09bf1990d105 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:30.826189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8d6924e5-8470-4a23-9429-4170e9a639ee None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:30.828168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8d6924e5-8470-4a23-9429-4170e9a639ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:30.836323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:30.869942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:30.885845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1dbb7-5c28-441b-bd12-140c2e165558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:30.887217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1dbb7-5c28-441b-bd12-140c2e165558 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:30.887649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1dbb7-5c28-441b-bd12-140c2e165558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:30.888093 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1dbb7-5c28-441b-bd12-140c2e165558 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:30.888903 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1dbb7-5c28-441b-bd12-140c2e165558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:30.893540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1dbb7-5c28-441b-bd12-140c2e165558 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:30.934803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1043/2089] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:30.949548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf0f74-a061-4012-b019-e239dc7557fc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:30.953173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1047/2090] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:30 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:30.954157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf0f74-a061-4012-b019-e239dc7557fc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:30.955781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf0f74-a061-4012-b019-e239dc7557fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:30.957505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1dbb7-5c28-441b-bd12-140c2e165558 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:30.959993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d7c1dbb7-5c28-441b-bd12-140c2e165558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:30.975108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1dbb7-5c28-441b-bd12-140c2e165558 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:30.986744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f215d33-a0db-44e5-911f-59e9ab603308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:30.987415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f215d33-a0db-44e5-911f-59e9ab603308 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:30.987700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f215d33-a0db-44e5-911f-59e9ab603308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:30.987971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f215d33-a0db-44e5-911f-59e9ab603308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:30.988893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f215d33-a0db-44e5-911f-59e9ab603308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:30.990766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f215d33-a0db-44e5-911f-59e9ab603308 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:30.997249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-22cf0f74-a061-4012-b019-e239dc7557fc None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:31.001664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-22cf0f74-a061-4012-b019-e239dc7557fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:31.006741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1048/2091] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:31.011308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f215d33-a0db-44e5-911f-59e9ab603308 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:31.029113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f215d33-a0db-44e5-911f-59e9ab603308 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:31.034225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1044/2092] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:31.036838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc300d7f-83c7-489c-a874-578bdd4eadcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:31.038105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc300d7f-83c7-489c-a874-578bdd4eadcb admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.038644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc300d7f-83c7-489c-a874-578bdd4eadcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.039129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf0f74-a061-4012-b019-e239dc7557fc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:31.039346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc300d7f-83c7-489c-a874-578bdd4eadcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.040653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc300d7f-83c7-489c-a874-578bdd4eadcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:31.042563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc300d7f-83c7-489c-a874-578bdd4eadcb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:31.056720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1049/2093] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:31.069534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc300d7f-83c7-489c-a874-578bdd4eadcb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:31.083386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc300d7f-83c7-489c-a874-578bdd4eadcb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:31.098422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf0f74-a061-4012-b019-e239dc7557fc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:31.102177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b95a46-fffd-4baf-90c8-79e62cce5b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:31.102863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b95a46-fffd-4baf-90c8-79e62cce5b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.103743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b95a46-fffd-4baf-90c8-79e62cce5b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.103743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b95a46-fffd-4baf-90c8-79e62cce5b93 admin admin] PATH_INFO: `/v3/projects/a3e78d4565ab4c8f8df51741f30f6583/users/d73d19d3cd0343ebace01dd2755ae5cc/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.115337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356e7e-2900-41d7-9db8-f4e299b01344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:31.116075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356e7e-2900-41d7-9db8-f4e299b01344 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.116410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356e7e-2900-41d7-9db8-f4e299b01344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.116758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356e7e-2900-41d7-9db8-f4e299b01344 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.117518 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0356e7e-2900-41d7-9db8-f4e299b01344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:31.117934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0356e7e-2900-41d7-9db8-f4e299b01344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:31.119641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0356e7e-2900-41d7-9db8-f4e299b01344 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:31.131905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b95a46-fffd-4baf-90c8-79e62cce5b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e78d4565ab4c8f8df51741f30f6583, user_id=d73d19d3cd0343ebace01dd2755ae5cc, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:31.134490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b95a46-fffd-4baf-90c8-79e62cce5b93 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:31.135494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1045/2094] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:13:31.141488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356e7e-2900-41d7-9db8-f4e299b01344 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:31.158491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356e7e-2900-41d7-9db8-f4e299b01344 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:31.174082 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1050/2095] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:31 2022] PUT /identity/v3/projects/a3e78d4565ab4c8f8df51741f30f6583/users/d73d19d3cd0343ebace01dd2755ae5cc/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:31.186037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ea54e-ab1f-455c-8d12-e03a7ee7f631 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.187176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ea54e-ab1f-455c-8d12-e03a7ee7f631 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.187559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ea54e-ab1f-455c-8d12-e03a7ee7f631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.255043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-531ea54e-ab1f-455c-8d12-e03a7ee7f631 None None] MFA Rules not processed for user `d73d19d3cd0343ebace01dd2755ae5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:31.257551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-531ea54e-ab1f-455c-8d12-e03a7ee7f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:31.274953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4a0ef-8b0a-4a19-9704-fb0d5917b474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:31.277429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a0ef-8b0a-4a19-9704-fb0d5917b474 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.277558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a0ef-8b0a-4a19-9704-fb0d5917b474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.278783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a0ef-8b0a-4a19-9704-fb0d5917b474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.279523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4a0ef-8b0a-4a19-9704-fb0d5917b474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:31.282811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4a0ef-8b0a-4a19-9704-fb0d5917b474 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:31.366791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1046/2096] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:31 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:31.371394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4a0ef-8b0a-4a19-9704-fb0d5917b474 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:31.412423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1051/2097] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:31.425667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ea54e-ab1f-455c-8d12-e03a7ee7f631 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:31.428641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-531ea54e-ab1f-455c-8d12-e03a7ee7f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:31.526546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4a0ef-8b0a-4a19-9704-fb0d5917b474 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:31.531488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676f253-4c59-43bd-b76f-e178b30527f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:31.533032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676f253-4c59-43bd-b76f-e178b30527f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.533395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676f253-4c59-43bd-b76f-e178b30527f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.533697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676f253-4c59-43bd-b76f-e178b30527f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.534335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676f253-4c59-43bd-b76f-e178b30527f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:31.536332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676f253-4c59-43bd-b76f-e178b30527f8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:31.572786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1047/2098] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:31 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:31.574323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676f253-4c59-43bd-b76f-e178b30527f8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:31.591947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:31.594063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676f253-4c59-43bd-b76f-e178b30527f8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:31.603063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ea54e-ab1f-455c-8d12-e03a7ee7f631 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:31.610158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86405659-3022-4697-b198-0f948bab4d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:31.610749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86405659-3022-4697-b198-0f948bab4d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.611027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86405659-3022-4697-b198-0f948bab4d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.611296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86405659-3022-4697-b198-0f948bab4d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.617452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86405659-3022-4697-b198-0f948bab4d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:31.620259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86405659-3022-4697-b198-0f948bab4d4b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:31.657115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1048/2099] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:31.659149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86405659-3022-4697-b198-0f948bab4d4b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:31.689681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86405659-3022-4697-b198-0f948bab4d4b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:31.697559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd143d-8f76-4455-8613-191052e19421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:31.698450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd143d-8f76-4455-8613-191052e19421 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.698737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd143d-8f76-4455-8613-191052e19421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.699235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd143d-8f76-4455-8613-191052e19421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.700074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd143d-8f76-4455-8613-191052e19421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:31.702591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd143d-8f76-4455-8613-191052e19421 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:31.724593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1049/2100] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:31.725462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd143d-8f76-4455-8613-191052e19421 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:31.736637 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:31.752578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd143d-8f76-4455-8613-191052e19421 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:31.761019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1603291-947a-4150-9e53-fcf6ac37e567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:31.761947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1603291-947a-4150-9e53-fcf6ac37e567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.762371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1603291-947a-4150-9e53-fcf6ac37e567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.763268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1603291-947a-4150-9e53-fcf6ac37e567 admin admin] PATH_INFO: `/v3/projects/52b390b0ef0a452d9eee41d1c3034fca/users/df04a265f9294b43b6198a6127b1bb58/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.767489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1294274-d6ff-4d4f-832c-202838f83c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:31.768982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294274-d6ff-4d4f-832c-202838f83c6c service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.769663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294274-d6ff-4d4f-832c-202838f83c6c service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.769997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294274-d6ff-4d4f-832c-202838f83c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.811198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1603291-947a-4150-9e53-fcf6ac37e567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b390b0ef0a452d9eee41d1c3034fca, user_id=df04a265f9294b43b6198a6127b1bb58, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:31.816033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1603291-947a-4150-9e53-fcf6ac37e567 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:31.865325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1050/2101] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:31 2022] PUT /identity/v3/projects/52b390b0ef0a452d9eee41d1c3034fca/users/df04a265f9294b43b6198a6127b1bb58/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:31.884981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f7d1c-ffff-4bde-87d9-cd85cfbbe974 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:31.886199 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f7d1c-ffff-4bde-87d9-cd85cfbbe974 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:31.887161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f7d1c-ffff-4bde-87d9-cd85cfbbe974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:31.933842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1294274-d6ff-4d4f-832c-202838f83c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:31.937739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1294274-d6ff-4d4f-832c-202838f83c6c service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:31.968887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1052/2102] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:31.972098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1f1f7d1c-ffff-4bde-87d9-cd85cfbbe974 None None] MFA Rules not processed for user `df04a265f9294b43b6198a6127b1bb58`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:31.973841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1f1f7d1c-ffff-4bde-87d9-cd85cfbbe974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:32.167558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1051/2103] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:32.176182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1294274-d6ff-4d4f-832c-202838f83c6c service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:32.188036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1294274-d6ff-4d4f-832c-202838f83c6c service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:32.327591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f7d1c-ffff-4bde-87d9-cd85cfbbe974 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:32.353569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e23d8-5de7-453f-beef-31c8b42a058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:32.356120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e23d8-5de7-453f-beef-31c8b42a058c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:32.359561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e23d8-5de7-453f-beef-31c8b42a058c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:32.373583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e23d8-5de7-453f-beef-31c8b42a058c admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:32.373583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e23d8-5de7-453f-beef-31c8b42a058c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:32.373583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e23d8-5de7-453f-beef-31c8b42a058c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:32.423833 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1053/2104] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:32 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:32.432324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e23d8-5de7-453f-beef-31c8b42a058c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:32.488035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:32.494577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f7d1c-ffff-4bde-87d9-cd85cfbbe974 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:32.580933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e23d8-5de7-453f-beef-31c8b42a058c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:32.587394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5782c-6679-4ae7-b1e4-730bb67f6e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:32.588019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5782c-6679-4ae7-b1e4-730bb67f6e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:32.588298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5782c-6679-4ae7-b1e4-730bb67f6e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:32.588680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5782c-6679-4ae7-b1e4-730bb67f6e38 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:32.589316 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5782c-6679-4ae7-b1e4-730bb67f6e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:32.591328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5782c-6679-4ae7-b1e4-730bb67f6e38 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:32.629267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1054/2105] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:32 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:32.633578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5782c-6679-4ae7-b1e4-730bb67f6e38 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:32.659846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5782c-6679-4ae7-b1e4-730bb67f6e38 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:32.667006 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:32.667667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:32.667947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:32.668511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] PATH_INFO: `/v3/users/d73d19d3cd0343ebace01dd2755ae5cc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:32.669922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73d19d3cd0343ebace01dd2755ae5cc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:32.672630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:32.677145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322b1a7-0e59-4ad3-b5ee-e736a2834e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:32.679158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b1a7-0e59-4ad3-b5ee-e736a2834e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:32.680551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b1a7-0e59-4ad3-b5ee-e736a2834e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:32.680865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b1a7-0e59-4ad3-b5ee-e736a2834e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:32.683801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322b1a7-0e59-4ad3-b5ee-e736a2834e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:32.691727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322b1a7-0e59-4ad3-b5ee-e736a2834e3c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:32.713254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1055/2106] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:32.718502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322b1a7-0e59-4ad3-b5ee-e736a2834e3c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:32.725037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:32.746417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322b1a7-0e59-4ad3-b5ee-e736a2834e3c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:32.754940 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7c1c7-ba38-436c-9bed-690d589cbe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:32.756095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7c1c7-ba38-436c-9bed-690d589cbe8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:32.756840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7c1c7-ba38-436c-9bed-690d589cbe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:32.757306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7c1c7-ba38-436c-9bed-690d589cbe8c admin admin] PATH_INFO: `/v3/projects/e302b47cb1434e89ad8b29823a48387e/users/2c9d338e8667421cb22172f586d286eb/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:32.779473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73d19d3cd0343ebace01dd2755ae5cc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:32.782585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7c1c7-ba38-436c-9bed-690d589cbe8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e302b47cb1434e89ad8b29823a48387e, user_id=2c9d338e8667421cb22172f586d286eb, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:32.786514 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7c1c7-ba38-436c-9bed-690d589cbe8c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:32.792534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73d19d3cd0343ebace01dd2755ae5cc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:32.793614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73d19d3cd0343ebace01dd2755ae5cc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:32.795182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73d19d3cd0343ebace01dd2755ae5cc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:32.806272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8c48b656-4baa-430f-8945-151b264e6094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73d19d3cd0343ebace01dd2755ae5cc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:32.810427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1056/2107] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:32 2022] PUT /identity/v3/projects/e302b47cb1434e89ad8b29823a48387e/users/2c9d338e8667421cb22172f586d286eb/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:32.815496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7c1c7-ba38-436c-9bed-690d589cbe8c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:32.818618 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7ce7c1c7-ba38-436c-9bed-690d589cbe8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:32.832834 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1052/2108] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:32 2022] DELETE /identity/v3/users/d73d19d3cd0343ebace01dd2755ae5cc => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:32.838949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10ad6c-39cb-4f99-9666-6dc011457046 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:32.839426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10ad6c-39cb-4f99-9666-6dc011457046 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:32.839846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10ad6c-39cb-4f99-9666-6dc011457046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:32.868878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-da10ad6c-39cb-4f99-9666-6dc011457046 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:32.870925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-da10ad6c-39cb-4f99-9666-6dc011457046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:32.916130 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7c1c7-ba38-436c-9bed-690d589cbe8c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:32.971077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1053/2109] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:32.980502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10ad6c-39cb-4f99-9666-6dc011457046 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:32.982605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-da10ad6c-39cb-4f99-9666-6dc011457046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:33.006792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92f046-3c07-43b5-a108-282898499719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:33.009189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92f046-3c07-43b5-a108-282898499719 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:33.009393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92f046-3c07-43b5-a108-282898499719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:33.009731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92f046-3c07-43b5-a108-282898499719 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:33.011554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92f046-3c07-43b5-a108-282898499719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:33.015912 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92f046-3c07-43b5-a108-282898499719 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:33.049730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1057/2110] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:33.053989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92f046-3c07-43b5-a108-282898499719 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:33.066229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92f046-3c07-43b5-a108-282898499719 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:33.072402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841359b-1e62-4449-8ba8-e6b8d97cc800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:33.073280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841359b-1e62-4449-8ba8-e6b8d97cc800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:33.073568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841359b-1e62-4449-8ba8-e6b8d97cc800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:33.074918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841359b-1e62-4449-8ba8-e6b8d97cc800 admin admin] PATH_INFO: `/v3/projects/e302b47cb1434e89ad8b29823a48387e/users/2c9d338e8667421cb22172f586d286eb/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:33.077537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841359b-1e62-4449-8ba8-e6b8d97cc800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e302b47cb1434e89ad8b29823a48387e, user_id=2c9d338e8667421cb22172f586d286eb, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:33.080632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841359b-1e62-4449-8ba8-e6b8d97cc800 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:33.094192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1058/2111] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:33 2022] PUT /identity/v3/projects/e302b47cb1434e89ad8b29823a48387e/users/2c9d338e8667421cb22172f586d286eb/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:33.103876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10ad6c-39cb-4f99-9666-6dc011457046 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:33.111510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816881-1507-4f35-9247-5107d741a4aa None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:33.111919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816881-1507-4f35-9247-5107d741a4aa None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:33.112260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816881-1507-4f35-9247-5107d741a4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:33.139303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:33.162042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e6816881-1507-4f35-9247-5107d741a4aa None None] MFA Rules not processed for user `2c9d338e8667421cb22172f586d286eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:33.163637 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e6816881-1507-4f35-9247-5107d741a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:33.185300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852f597-46fc-4e31-b7b9-278f2ce5a75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:33.186450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852f597-46fc-4e31-b7b9-278f2ce5a75e service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:33.188292 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852f597-46fc-4e31-b7b9-278f2ce5a75e service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:33.188650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852f597-46fc-4e31-b7b9-278f2ce5a75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:33.194920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:33.291456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1059/2112] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:33.293318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816881-1507-4f35-9247-5107d741a4aa None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:33.294873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852f597-46fc-4e31-b7b9-278f2ce5a75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:33.295010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e6816881-1507-4f35-9247-5107d741a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:33.296577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852f597-46fc-4e31-b7b9-278f2ce5a75e service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:33.309192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1054/2113] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:33.391046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816881-1507-4f35-9247-5107d741a4aa None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:33.397673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9e47-dc93-4013-908a-b35712b4a6e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:33.398374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9e47-dc93-4013-908a-b35712b4a6e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:33.398701 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9e47-dc93-4013-908a-b35712b4a6e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:33.399682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9e47-dc93-4013-908a-b35712b4a6e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:33.401907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-910e9e47-dc93-4013-908a-b35712b4a6e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:33.506417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e9e47-dc93-4013-908a-b35712b4a6e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:33.508210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e9e47-dc93-4013-908a-b35712b4a6e4 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:33.521364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1060/2114] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:34.083194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852f597-46fc-4e31-b7b9-278f2ce5a75e service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:34.085987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2852f597-46fc-4e31-b7b9-278f2ce5a75e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:34.118857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852f597-46fc-4e31-b7b9-278f2ce5a75e service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:34.134314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:34.134954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:34.135233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:34.135506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] PATH_INFO: `/v3/projects/a3e78d4565ab4c8f8df51741f30f6583` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:34.142496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e78d4565ab4c8f8df51741f30f6583)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:34.144523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:34.230077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e78d4565ab4c8f8df51741f30f6583', 'request_id': 'req-29754cb6-099f-41ce-8cfe-7626fa748ad0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:34.259208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e78d4565ab4c8f8df51741f30f6583', 'request_id': 'req-29754cb6-099f-41ce-8cfe-7626fa748ad0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:34.268183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e78d4565ab4c8f8df51741f30f6583', 'request_id': 'req-29754cb6-099f-41ce-8cfe-7626fa748ad0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:34.289219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] The token cache is being invalidate because project a3e78d4565ab4c8f8df51741f30f6583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:34.289532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:34.290402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29754cb6-099f-41ce-8cfe-7626fa748ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:34.294867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1055/2115] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:34 2022] DELETE /identity/v3/projects/a3e78d4565ab4c8f8df51741f30f6583 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:34.300019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242c4ee-f5ad-4d39-8a37-8755948d907d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:34.300522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242c4ee-f5ad-4d39-8a37-8755948d907d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:34.300601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242c4ee-f5ad-4d39-8a37-8755948d907d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:34.364031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4242c4ee-f5ad-4d39-8a37-8755948d907d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:34.365524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4242c4ee-f5ad-4d39-8a37-8755948d907d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:34.461414 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:34.486668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1061/2116] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:34.495318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27ff7e-e0b8-43ec-bae5-578c105dd631 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:34.495621 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27ff7e-e0b8-43ec-bae5-578c105dd631 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:34.496434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27ff7e-e0b8-43ec-bae5-578c105dd631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:34.529333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1a27ff7e-e0b8-43ec-bae5-578c105dd631 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:34.530848 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1a27ff7e-e0b8-43ec-bae5-578c105dd631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:34.544802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1056/2117] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:34.546864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242c4ee-f5ad-4d39-8a37-8755948d907d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:34.567320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242c4ee-f5ad-4d39-8a37-8755948d907d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:34.577608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b813bb-604e-4974-acf6-f13903ed22ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:34.578272 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b813bb-604e-4974-acf6-f13903ed22ed admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:34.579114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b813bb-604e-4974-acf6-f13903ed22ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:34.579853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b813bb-604e-4974-acf6-f13903ed22ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:34.580116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b813bb-604e-4974-acf6-f13903ed22ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:34.580425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b813bb-604e-4974-acf6-f13903ed22ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:34.582798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b813bb-604e-4974-acf6-f13903ed22ed admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:34.617792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1062/2118] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:13:34.619143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27ff7e-e0b8-43ec-bae5-578c105dd631 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:34.635386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27ff7e-e0b8-43ec-bae5-578c105dd631 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:34.648181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43543ef-2bc4-4175-ae7d-1bdfe36733b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:34.649439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43543ef-2bc4-4175-ae7d-1bdfe36733b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:34.649842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43543ef-2bc4-4175-ae7d-1bdfe36733b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:34.650195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43543ef-2bc4-4175-ae7d-1bdfe36733b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:34.651684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43543ef-2bc4-4175-ae7d-1bdfe36733b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:34.655648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43543ef-2bc4-4175-ae7d-1bdfe36733b8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:34.714066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1057/2119] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:34 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:34.719265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b813bb-604e-4974-acf6-f13903ed22ed admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:34.731325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b813bb-604e-4974-acf6-f13903ed22ed admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:34.835649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5cbb3-0a03-4921-a869-d3c5b1e607e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:34.836415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5cbb3-0a03-4921-a869-d3c5b1e607e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:34.836808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5cbb3-0a03-4921-a869-d3c5b1e607e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:34.837178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5cbb3-0a03-4921-a869-d3c5b1e607e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:34.838122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5cbb3-0a03-4921-a869-d3c5b1e607e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:34.840320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5cbb3-0a03-4921-a869-d3c5b1e607e6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:34.871102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1063/2120] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:34 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:34.876382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43543ef-2bc4-4175-ae7d-1bdfe36733b8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:34.904300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43543ef-2bc4-4175-ae7d-1bdfe36733b8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:34.915205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2be57-9e70-45a7-bf43-cafd28ff214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:34.922232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2be57-9e70-45a7-bf43-cafd28ff214c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:34.922232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2be57-9e70-45a7-bf43-cafd28ff214c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:34.922232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2be57-9e70-45a7-bf43-cafd28ff214c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:34.922232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2be57-9e70-45a7-bf43-cafd28ff214c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:34.922232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2be57-9e70-45a7-bf43-cafd28ff214c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:34.964583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1058/2121] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:34.965972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5cbb3-0a03-4921-a869-d3c5b1e607e6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:34.977007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5cbb3-0a03-4921-a869-d3c5b1e607e6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:34.982119 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d432f84-fa3f-475f-8d24-c487c4b5559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:34.982698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432f84-fa3f-475f-8d24-c487c4b5559e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:34.984773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432f84-fa3f-475f-8d24-c487c4b5559e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:34.984773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432f84-fa3f-475f-8d24-c487c4b5559e admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:34.984773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d432f84-fa3f-475f-8d24-c487c4b5559e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:34.987222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d432f84-fa3f-475f-8d24-c487c4b5559e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:35.008343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1064/2122] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:35.016090 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2be57-9e70-45a7-bf43-cafd28ff214c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:35.030906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2be57-9e70-45a7-bf43-cafd28ff214c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:35.037029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec9a14-d778-4eab-913f-b1a30238d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:35.037928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9a14-d778-4eab-913f-b1a30238d79c admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.038314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9a14-d778-4eab-913f-b1a30238d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.038700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9a14-d778-4eab-913f-b1a30238d79c admin admin] PATH_INFO: `/v3/projects/ada84489ccde4064a412587a1d593dac/users/91e58730d7c64f89b6530b7718a7a43a/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.056773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec9a14-d778-4eab-913f-b1a30238d79c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada84489ccde4064a412587a1d593dac, user_id=91e58730d7c64f89b6530b7718a7a43a, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:35.059994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec9a14-d778-4eab-913f-b1a30238d79c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:35.099836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da85deb-10be-40e4-88a2-0f3e96b13c82 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.100190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da85deb-10be-40e4-88a2-0f3e96b13c82 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.100478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da85deb-10be-40e4-88a2-0f3e96b13c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.101820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1059/2123] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:35 2022] PUT /identity/v3/projects/ada84489ccde4064a412587a1d593dac/users/91e58730d7c64f89b6530b7718a7a43a/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:35.143579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1da85deb-10be-40e4-88a2-0f3e96b13c82 None None] MFA Rules not processed for user `91e58730d7c64f89b6530b7718a7a43a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:35.147177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1da85deb-10be-40e4-88a2-0f3e96b13c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:35.257843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1065/2124] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:35.262040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec9a14-d778-4eab-913f-b1a30238d79c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:35.306679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:35.310932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e9c03-efa5-49a6-95ba-66839418cd6d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.311672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e9c03-efa5-49a6-95ba-66839418cd6d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.311672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e9c03-efa5-49a6-95ba-66839418cd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.368710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-670e9c03-efa5-49a6-95ba-66839418cd6d None None] MFA Rules not processed for user `cd2edb3eefa5428e97b4742d70f719b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:35.374087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-670e9c03-efa5-49a6-95ba-66839418cd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:35.381483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec9a14-d778-4eab-913f-b1a30238d79c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:35.387494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6d224-328d-4f17-8592-0ac9a5d729b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:35.388177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6d224-328d-4f17-8592-0ac9a5d729b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.388597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6d224-328d-4f17-8592-0ac9a5d729b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.388748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6d224-328d-4f17-8592-0ac9a5d729b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.390003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6d224-328d-4f17-8592-0ac9a5d729b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:35.392287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6d224-328d-4f17-8592-0ac9a5d729b5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:35.418969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:35.431625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1060/2125] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:35 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:35.435808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6d224-328d-4f17-8592-0ac9a5d729b5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:35.469804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1066/2126] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:35.472908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e9c03-efa5-49a6-95ba-66839418cd6d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:35.474671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-670e9c03-efa5-49a6-95ba-66839418cd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:35.503214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e9c03-efa5-49a6-95ba-66839418cd6d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:35.541551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6d224-328d-4f17-8592-0ac9a5d729b5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:35.550964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ea0ca-d4a6-4b4b-aed8-1f522b3031a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:35.551628 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ea0ca-d4a6-4b4b-aed8-1f522b3031a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.551960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ea0ca-d4a6-4b4b-aed8-1f522b3031a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.552234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ea0ca-d4a6-4b4b-aed8-1f522b3031a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.553125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ea0ca-d4a6-4b4b-aed8-1f522b3031a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:35.569344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ea0ca-d4a6-4b4b-aed8-1f522b3031a9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:35.599080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42254cbb-1661-4320-902d-5e4bd9f36827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:35.600413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42254cbb-1661-4320-902d-5e4bd9f36827 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.600723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42254cbb-1661-4320-902d-5e4bd9f36827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.601080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42254cbb-1661-4320-902d-5e4bd9f36827 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.601880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42254cbb-1661-4320-902d-5e4bd9f36827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:35.604217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42254cbb-1661-4320-902d-5e4bd9f36827 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:35.605689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1061/2127] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:35 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:35.609092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ea0ca-d4a6-4b4b-aed8-1f522b3031a9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:35.630454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ea0ca-d4a6-4b4b-aed8-1f522b3031a9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:35.635480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd7355-cdc5-464a-badd-7429139f5aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:35.636093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd7355-cdc5-464a-badd-7429139f5aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.636371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd7355-cdc5-464a-badd-7429139f5aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.636646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd7355-cdc5-464a-badd-7429139f5aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.637287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd7355-cdc5-464a-badd-7429139f5aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:35.639032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd7355-cdc5-464a-badd-7429139f5aa5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:35.643615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1067/2128] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:35 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:35.647590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42254cbb-1661-4320-902d-5e4bd9f36827 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:35.651962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1062/2129] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:35.657789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd7355-cdc5-464a-badd-7429139f5aa5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:35.676960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd7355-cdc5-464a-badd-7429139f5aa5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:35.725213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42254cbb-1661-4320-902d-5e4bd9f36827 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:35.734102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded71ac-c64a-45c5-a47c-0d405b33361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:35.734832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded71ac-c64a-45c5-a47c-0d405b33361e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.735189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded71ac-c64a-45c5-a47c-0d405b33361e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.735606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded71ac-c64a-45c5-a47c-0d405b33361e admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.736339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded71ac-c64a-45c5-a47c-0d405b33361e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:35.738779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded71ac-c64a-45c5-a47c-0d405b33361e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:35.755310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e3ab5-2a70-4cef-96a0-be556b5d7892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:35.756499 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e3ab5-2a70-4cef-96a0-be556b5d7892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.756968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e3ab5-2a70-4cef-96a0-be556b5d7892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.757430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e3ab5-2a70-4cef-96a0-be556b5d7892 admin admin] PATH_INFO: `/v3/projects/2620ecfcf557437689cc6087dfe8be4c/users/ef237b45b9ed41f98ffc43c4c29c837d/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.773708 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1068/2130] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:35 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:35.777879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded71ac-c64a-45c5-a47c-0d405b33361e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:35.790580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded71ac-c64a-45c5-a47c-0d405b33361e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:35.796392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e3ab5-2a70-4cef-96a0-be556b5d7892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2620ecfcf557437689cc6087dfe8be4c, user_id=ef237b45b9ed41f98ffc43c4c29c837d, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:35.796540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9dc22-2728-43f1-ac1c-b053897bb947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:35.797022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9dc22-2728-43f1-ac1c-b053897bb947 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.798568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9dc22-2728-43f1-ac1c-b053897bb947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.798568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9dc22-2728-43f1-ac1c-b053897bb947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.799085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9dc22-2728-43f1-ac1c-b053897bb947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:35.799207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e3ab5-2a70-4cef-96a0-be556b5d7892 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:35.801230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9dc22-2728-43f1-ac1c-b053897bb947 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:35.823920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1069/2131] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:35.827887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9dc22-2728-43f1-ac1c-b053897bb947 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:35.843721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9dc22-2728-43f1-ac1c-b053897bb947 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:35.844121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1063/2132] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:35 2022] PUT /identity/v3/projects/2620ecfcf557437689cc6087dfe8be4c/users/ef237b45b9ed41f98ffc43c4c29c837d/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:35.845367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e3ab5-2a70-4cef-96a0-be556b5d7892 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:35.860746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:35.931793 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:35.959934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e3ab5-2a70-4cef-96a0-be556b5d7892 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:35.966589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712fd53-37b8-40f6-ae39-a5691e739c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:35.967264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712fd53-37b8-40f6-ae39-a5691e739c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.967989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107c18e-1e82-4915-b3bd-7e24709afb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:35.968504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712fd53-37b8-40f6-ae39-a5691e739c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.968632 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107c18e-1e82-4915-b3bd-7e24709afb08 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:35.968783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712fd53-37b8-40f6-ae39-a5691e739c4f admin admin] PATH_INFO: `/v3/projects/a8f5abb0e25d427c9127e635c13843ca/users/5935e6b505174f0c9a437b303bbbf24f/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.969136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107c18e-1e82-4915-b3bd-7e24709afb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:35.969472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107c18e-1e82-4915-b3bd-7e24709afb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:35.970590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107c18e-1e82-4915-b3bd-7e24709afb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:35.976783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107c18e-1e82-4915-b3bd-7e24709afb08 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:35.993517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712fd53-37b8-40f6-ae39-a5691e739c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f5abb0e25d427c9127e635c13843ca, user_id=5935e6b505174f0c9a437b303bbbf24f, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:35.996091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1064/2133] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:36.001184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107c18e-1e82-4915-b3bd-7e24709afb08 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:36.001571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712fd53-37b8-40f6-ae39-a5691e739c4f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:36.025007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107c18e-1e82-4915-b3bd-7e24709afb08 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:36.025159 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1070/2134] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:35 2022] PUT /identity/v3/projects/a8f5abb0e25d427c9127e635c13843ca/users/5935e6b505174f0c9a437b303bbbf24f/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:36.026142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712fd53-37b8-40f6-ae39-a5691e739c4f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:36.133006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712fd53-37b8-40f6-ae39-a5691e739c4f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:36.148366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32442f2b-1ad3-469b-af03-bee376dfbb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:36.152121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32442f2b-1ad3-469b-af03-bee376dfbb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:36.152456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32442f2b-1ad3-469b-af03-bee376dfbb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:36.152836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32442f2b-1ad3-469b-af03-bee376dfbb87 admin admin] PATH_INFO: `/v3/projects/2620ecfcf557437689cc6087dfe8be4c/users/ef237b45b9ed41f98ffc43c4c29c837d/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:36.156166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32442f2b-1ad3-469b-af03-bee376dfbb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2620ecfcf557437689cc6087dfe8be4c, user_id=ef237b45b9ed41f98ffc43c4c29c837d, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:36.156355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd2bd-5a2b-466f-a915-d4c2841d6020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:36.156856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd2bd-5a2b-466f-a915-d4c2841d6020 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:36.157137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd2bd-5a2b-466f-a915-d4c2841d6020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:36.157410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd2bd-5a2b-466f-a915-d4c2841d6020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:36.158088 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd2bd-5a2b-466f-a915-d4c2841d6020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:36.159019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32442f2b-1ad3-469b-af03-bee376dfbb87 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:36.160033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd2bd-5a2b-466f-a915-d4c2841d6020 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:36.174299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1065/2135] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:35 2022] PUT /identity/v3/projects/2620ecfcf557437689cc6087dfe8be4c/users/ef237b45b9ed41f98ffc43c4c29c837d/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:36.190595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1071/2136] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:36.196475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd2bd-5a2b-466f-a915-d4c2841d6020 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:36.214800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc72c87-9bfa-4e5f-a105-b8aa7cd7a2e9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:36.215042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd2bd-5a2b-466f-a915-d4c2841d6020 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:36.215151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc72c87-9bfa-4e5f-a105-b8aa7cd7a2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:36.215151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc72c87-9bfa-4e5f-a105-b8aa7cd7a2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:36.249697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6dc72c87-9bfa-4e5f-a105-b8aa7cd7a2e9 None None] MFA Rules not processed for user `ef237b45b9ed41f98ffc43c4c29c837d`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:36.251380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6dc72c87-9bfa-4e5f-a105-b8aa7cd7a2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:36.293699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81240ee-516a-4e2e-874c-0cb835766ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:36.294446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81240ee-516a-4e2e-874c-0cb835766ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:36.294744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81240ee-516a-4e2e-874c-0cb835766ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:36.295027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81240ee-516a-4e2e-874c-0cb835766ffd admin admin] PATH_INFO: `/v3/projects/a8f5abb0e25d427c9127e635c13843ca/users/5935e6b505174f0c9a437b303bbbf24f/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:36.298045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81240ee-516a-4e2e-874c-0cb835766ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f5abb0e25d427c9127e635c13843ca, user_id=5935e6b505174f0c9a437b303bbbf24f, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:36.301722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81240ee-516a-4e2e-874c-0cb835766ffd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:36.314016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1072/2137] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:36 2022] PUT /identity/v3/projects/a8f5abb0e25d427c9127e635c13843ca/users/5935e6b505174f0c9a437b303bbbf24f/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:36.409339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1066/2138] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:36.438440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81240ee-516a-4e2e-874c-0cb835766ffd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:36.447660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d81240ee-516a-4e2e-874c-0cb835766ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:36.552869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81240ee-516a-4e2e-874c-0cb835766ffd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:36.569182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3bca8-79bc-4f26-9cdf-a06e794ec9b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:36.569977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3bca8-79bc-4f26-9cdf-a06e794ec9b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:36.570320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3bca8-79bc-4f26-9cdf-a06e794ec9b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:36.570680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3bca8-79bc-4f26-9cdf-a06e794ec9b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:36.575846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:36.674719 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3bca8-79bc-4f26-9cdf-a06e794ec9b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:36.678080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3bca8-79bc-4f26-9cdf-a06e794ec9b5 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:36.702783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1073/2139] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:36.969007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc72c87-9bfa-4e5f-a105-b8aa7cd7a2e9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:36.979992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc72c87-9bfa-4e5f-a105-b8aa7cd7a2e9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:37.005853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:37.046946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:37.047589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:37.047917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:37.048164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] PATH_INFO: `/v3/users/91e58730d7c64f89b6530b7718a7a43a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:37.049297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e58730d7c64f89b6530b7718a7a43a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:37.051470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:37.136149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e58730d7c64f89b6530b7718a7a43a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:37.147399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e58730d7c64f89b6530b7718a7a43a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:37.148123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e58730d7c64f89b6530b7718a7a43a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:37.148764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e58730d7c64f89b6530b7718a7a43a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:37.158593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e58730d7c64f89b6530b7718a7a43a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:37.185720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1067/2140] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:36 2022] DELETE /identity/v3/users/91e58730d7c64f89b6530b7718a7a43a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:37.191835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7eec3-d75a-4857-96fc-e347f9d5c54a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:37.192240 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7eec3-d75a-4857-96fc-e347f9d5c54a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:37.192558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7eec3-d75a-4857-96fc-e347f9d5c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:37.218801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-81f7eec3-d75a-4857-96fc-e347f9d5c54a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:37.220321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-81f7eec3-d75a-4857-96fc-e347f9d5c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:37.319088 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1074/2141] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:37.331625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:37.333521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:37.412418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49651606-815f-4221-8e0f-07a58633c5a6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:37.417840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5f0cf-f750-4b0e-a684-dae41685fe40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:37.419057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5f0cf-f750-4b0e-a684-dae41685fe40 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:37.419057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5f0cf-f750-4b0e-a684-dae41685fe40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:37.419057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5f0cf-f750-4b0e-a684-dae41685fe40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:37.432219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5f0cf-f750-4b0e-a684-dae41685fe40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:37.433883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5f0cf-f750-4b0e-a684-dae41685fe40 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:37.456782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1068/2142] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:37.874302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7eec3-d75a-4857-96fc-e347f9d5c54a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:37.876508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-81f7eec3-d75a-4857-96fc-e347f9d5c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:37.915130 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7eec3-d75a-4857-96fc-e347f9d5c54a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:37.938100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:37.938367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5f0cf-f750-4b0e-a684-dae41685fe40 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:37.939186 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:37.939640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:37.939764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-aee5f0cf-f750-4b0e-a684-dae41685fe40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:37.940179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] PATH_INFO: `/v3/projects/ada84489ccde4064a412587a1d593dac` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:37.942631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada84489ccde4064a412587a1d593dac)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:37.946146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:38.034626 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:38.062181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5f0cf-f750-4b0e-a684-dae41685fe40 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:38.077890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada84489ccde4064a412587a1d593dac', 'request_id': 'req-434518f4-31b7-49f8-946f-ca7d405d06e6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:38.091509 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada84489ccde4064a412587a1d593dac', 'request_id': 'req-434518f4-31b7-49f8-946f-ca7d405d06e6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:38.110667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada84489ccde4064a412587a1d593dac', 'request_id': 'req-434518f4-31b7-49f8-946f-ca7d405d06e6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:38.136129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] The token cache is being invalidate because project ada84489ccde4064a412587a1d593dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:38.136562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:38.138327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:38.141590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1075/2143] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:37 2022] DELETE /identity/v3/projects/ada84489ccde4064a412587a1d593dac => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:38.143203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446773d2-736a-4daa-9a7a-eb2c57b4a7fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:38.144070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446773d2-736a-4daa-9a7a-eb2c57b4a7fd service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:38.144714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446773d2-736a-4daa-9a7a-eb2c57b4a7fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:38.145427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446773d2-736a-4daa-9a7a-eb2c57b4a7fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:38.146304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:38.148853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:38.149413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-446773d2-736a-4daa-9a7a-eb2c57b4a7fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:38.222702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:38.278827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446773d2-736a-4daa-9a7a-eb2c57b4a7fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:38.281659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446773d2-736a-4daa-9a7a-eb2c57b4a7fd service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:38.296384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1069/2144] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:38.316113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434518f4-31b7-49f8-946f-ca7d405d06e6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:38.335155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:38.335849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:38.336069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:38.336344 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] PATH_INFO: `/v3/users/ef237b45b9ed41f98ffc43c4c29c837d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:38.337709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef237b45b9ed41f98ffc43c4c29c837d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:38.339628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:38.454745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef237b45b9ed41f98ffc43c4c29c837d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:38.482381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef237b45b9ed41f98ffc43c4c29c837d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:38.492866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef237b45b9ed41f98ffc43c4c29c837d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:38.493890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef237b45b9ed41f98ffc43c4c29c837d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:38.513317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e23d4718-726e-4709-bd1f-af841a420330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef237b45b9ed41f98ffc43c4c29c837d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:38.546636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1076/2145] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:38 2022] DELETE /identity/v3/users/ef237b45b9ed41f98ffc43c4c29c837d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:39.296359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446773d2-736a-4daa-9a7a-eb2c57b4a7fd service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:39.311936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446773d2-736a-4daa-9a7a-eb2c57b4a7fd service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:39.394381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:39.394913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:39.395364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:39.395797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] PATH_INFO: `/v3/projects/2620ecfcf557437689cc6087dfe8be4c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:39.397106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2620ecfcf557437689cc6087dfe8be4c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:39.400023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:39.474246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2620ecfcf557437689cc6087dfe8be4c', 'request_id': 'req-3ad1ffd6-c913-4ea5-9240-998770b71a1b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:39.479201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:39.492487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2620ecfcf557437689cc6087dfe8be4c', 'request_id': 'req-3ad1ffd6-c913-4ea5-9240-998770b71a1b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:39.515287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2620ecfcf557437689cc6087dfe8be4c', 'request_id': 'req-3ad1ffd6-c913-4ea5-9240-998770b71a1b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:39.537720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] The token cache is being invalidate because project 2620ecfcf557437689cc6087dfe8be4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:39.538393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:39.540175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3ad1ffd6-c913-4ea5-9240-998770b71a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:39.542622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1070/2146] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:39 2022] DELETE /identity/v3/projects/2620ecfcf557437689cc6087dfe8be4c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:39.548916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5fb6-6884-438d-8889-b621dab8d836 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:39.550568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5fb6-6884-438d-8889-b621dab8d836 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:39.551061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5fb6-6884-438d-8889-b621dab8d836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:39.589650 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-386e5fb6-6884-438d-8889-b621dab8d836 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:39.592026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-386e5fb6-6884-438d-8889-b621dab8d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:39.705531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1077/2147] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:39.708464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf67e-73e4-41ae-9d66-fa878317dad1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:39.709062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf67e-73e4-41ae-9d66-fa878317dad1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:39.709062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf67e-73e4-41ae-9d66-fa878317dad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:39.735036 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dd7cf67e-73e4-41ae-9d66-fa878317dad1 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:39.736272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dd7cf67e-73e4-41ae-9d66-fa878317dad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:39.745032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1071/2148] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:39.749864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e5fb6-6884-438d-8889-b621dab8d836 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:39.761193 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e5fb6-6884-438d-8889-b621dab8d836 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:39.772840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf5aad-bb6b-438e-878b-4aa5b49b7f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:39.773568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf5aad-bb6b-438e-878b-4aa5b49b7f2d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:39.773953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf5aad-bb6b-438e-878b-4aa5b49b7f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:39.774580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf5aad-bb6b-438e-878b-4aa5b49b7f2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:39.775579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf5aad-bb6b-438e-878b-4aa5b49b7f2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:39.776135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf5aad-bb6b-438e-878b-4aa5b49b7f2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:39.779031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf5aad-bb6b-438e-878b-4aa5b49b7f2d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:39.804990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1078/2149] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:13:39.809996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cf67e-73e4-41ae-9d66-fa878317dad1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:39.828276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cf67e-73e4-41ae-9d66-fa878317dad1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:39.844007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16100ad0-708a-49d1-8a62-3520940dbaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:39.844805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16100ad0-708a-49d1-8a62-3520940dbaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:39.845091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16100ad0-708a-49d1-8a62-3520940dbaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:39.848668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16100ad0-708a-49d1-8a62-3520940dbaf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:39.849454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16100ad0-708a-49d1-8a62-3520940dbaf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:39.856775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16100ad0-708a-49d1-8a62-3520940dbaf2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:39.932100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1072/2150] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:39 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:39.936872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf5aad-bb6b-438e-878b-4aa5b49b7f2d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:39.952305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf5aad-bb6b-438e-878b-4aa5b49b7f2d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:40.014404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:40.088644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a990dd-bf01-4269-b223-46ac1ffe0a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:40.089555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a990dd-bf01-4269-b223-46ac1ffe0a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:40.089876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a990dd-bf01-4269-b223-46ac1ffe0a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:40.090152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a990dd-bf01-4269-b223-46ac1ffe0a6f admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:40.091338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a990dd-bf01-4269-b223-46ac1ffe0a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:40.093836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a990dd-bf01-4269-b223-46ac1ffe0a6f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:40.153793 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1079/2151] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:39 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:40.164167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16100ad0-708a-49d1-8a62-3520940dbaf2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:40.182434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16100ad0-708a-49d1-8a62-3520940dbaf2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:40.201243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd41c9-e2e3-4f0f-9003-8d036d0c0df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:40.202459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd41c9-e2e3-4f0f-9003-8d036d0c0df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:40.202745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd41c9-e2e3-4f0f-9003-8d036d0c0df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:40.203017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd41c9-e2e3-4f0f-9003-8d036d0c0df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:40.204266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd41c9-e2e3-4f0f-9003-8d036d0c0df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:40.205694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd41c9-e2e3-4f0f-9003-8d036d0c0df8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:40.225967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1073/2152] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:40.230512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a990dd-bf01-4269-b223-46ac1ffe0a6f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:40.261844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a990dd-bf01-4269-b223-46ac1ffe0a6f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:40.267894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aba7d-4dcf-4649-9668-9dfb6afbc684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:40.268577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aba7d-4dcf-4649-9668-9dfb6afbc684 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:40.268991 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aba7d-4dcf-4649-9668-9dfb6afbc684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:40.269723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aba7d-4dcf-4649-9668-9dfb6afbc684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:40.270376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aba7d-4dcf-4649-9668-9dfb6afbc684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:40.276720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aba7d-4dcf-4649-9668-9dfb6afbc684 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:40.295831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1080/2153] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:40.300180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd41c9-e2e3-4f0f-9003-8d036d0c0df8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:40.317201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd41c9-e2e3-4f0f-9003-8d036d0c0df8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:40.339523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6728e9-75cd-4c60-83d3-201f3cdb5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:40.339725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6728e9-75cd-4c60-83d3-201f3cdb5dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:40.340183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6728e9-75cd-4c60-83d3-201f3cdb5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:40.340615 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6728e9-75cd-4c60-83d3-201f3cdb5dc4 admin admin] PATH_INFO: `/v3/projects/65935356afb846ee83fee05e48423d63/users/fe90b66546f1484e981724556840da59/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:40.401454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6728e9-75cd-4c60-83d3-201f3cdb5dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65935356afb846ee83fee05e48423d63, user_id=fe90b66546f1484e981724556840da59, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:40.404198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6728e9-75cd-4c60-83d3-201f3cdb5dc4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:40.444941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1074/2154] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:40 2022] PUT /identity/v3/projects/65935356afb846ee83fee05e48423d63/users/fe90b66546f1484e981724556840da59/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:40.455413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2d71a-25bb-40a5-b1fc-cacaba63e680 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:40.458415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2d71a-25bb-40a5-b1fc-cacaba63e680 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:40.458929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2d71a-25bb-40a5-b1fc-cacaba63e680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:40.542649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-05f2d71a-25bb-40a5-b1fc-cacaba63e680 None None] MFA Rules not processed for user `fe90b66546f1484e981724556840da59`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:40.544291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-05f2d71a-25bb-40a5-b1fc-cacaba63e680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:40.697826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1081/2155] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:40.702015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6728e9-75cd-4c60-83d3-201f3cdb5dc4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:40.800861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6728e9-75cd-4c60-83d3-201f3cdb5dc4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:40.806809 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a85f94-7410-490e-b2c8-2105136953fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:40.807607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a85f94-7410-490e-b2c8-2105136953fc admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:40.809086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a85f94-7410-490e-b2c8-2105136953fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:40.809514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a85f94-7410-490e-b2c8-2105136953fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:40.813773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a85f94-7410-490e-b2c8-2105136953fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:40.819776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a85f94-7410-490e-b2c8-2105136953fc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:40.875920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1075/2156] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:40 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:40.877254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2d71a-25bb-40a5-b1fc-cacaba63e680 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:40.897413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2d71a-25bb-40a5-b1fc-cacaba63e680 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:40.978123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23860f-fe7c-46df-9de2-12a2f835b9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:40.978831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23860f-fe7c-46df-9de2-12a2f835b9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:40.979409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23860f-fe7c-46df-9de2-12a2f835b9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:40.979409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23860f-fe7c-46df-9de2-12a2f835b9f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:40.980563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23860f-fe7c-46df-9de2-12a2f835b9f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:40.983658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23860f-fe7c-46df-9de2-12a2f835b9f4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:41.016835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1082/2157] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:40 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:41.018547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a85f94-7410-490e-b2c8-2105136953fc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:41.030623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a85f94-7410-490e-b2c8-2105136953fc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:41.036145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1165b-7aa3-479c-8a56-0960ee5ecff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:41.036789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1165b-7aa3-479c-8a56-0960ee5ecff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:41.037126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1165b-7aa3-479c-8a56-0960ee5ecff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:41.037407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1165b-7aa3-479c-8a56-0960ee5ecff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:41.038160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1165b-7aa3-479c-8a56-0960ee5ecff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:41.039934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1165b-7aa3-479c-8a56-0960ee5ecff1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:41.062813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1076/2158] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:41.064024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23860f-fe7c-46df-9de2-12a2f835b9f4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:41.075599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23860f-fe7c-46df-9de2-12a2f835b9f4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:41.084039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966f081-1daf-46f6-a3c5-73cd8b9538a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:41.084725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966f081-1daf-46f6-a3c5-73cd8b9538a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:41.085008 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966f081-1daf-46f6-a3c5-73cd8b9538a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:41.085282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966f081-1daf-46f6-a3c5-73cd8b9538a9 admin admin] PATH_INFO: `/v3/projects/061e8e1a4dfc4104adf11472736be95f/users/12463c41270648a3b7c474c83f417c75/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:41.126386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966f081-1daf-46f6-a3c5-73cd8b9538a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061e8e1a4dfc4104adf11472736be95f, user_id=12463c41270648a3b7c474c83f417c75, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:41.135447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966f081-1daf-46f6-a3c5-73cd8b9538a9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:41.171415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1083/2159] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:41 2022] PUT /identity/v3/projects/061e8e1a4dfc4104adf11472736be95f/users/12463c41270648a3b7c474c83f417c75/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:41.175341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1165b-7aa3-479c-8a56-0960ee5ecff1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:41.188347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1165b-7aa3-479c-8a56-0960ee5ecff1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:41.284568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:41.307666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad20f83-9d22-4d96-bb91-09c2321239c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:41.309426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad20f83-9d22-4d96-bb91-09c2321239c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:41.309928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad20f83-9d22-4d96-bb91-09c2321239c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:41.310534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad20f83-9d22-4d96-bb91-09c2321239c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:41.312468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad20f83-9d22-4d96-bb91-09c2321239c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:41.317051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad20f83-9d22-4d96-bb91-09c2321239c4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:41.333121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1077/2160] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:41.337764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966f081-1daf-46f6-a3c5-73cd8b9538a9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:41.352832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:41.357458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966f081-1daf-46f6-a3c5-73cd8b9538a9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:41.366313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e456-26c6-46e3-af65-342dadd13e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:41.374821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e456-26c6-46e3-af65-342dadd13e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:41.375100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e456-26c6-46e3-af65-342dadd13e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:41.375374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e456-26c6-46e3-af65-342dadd13e66 admin admin] PATH_INFO: `/v3/projects/061e8e1a4dfc4104adf11472736be95f/users/12463c41270648a3b7c474c83f417c75/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:41.378893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508e456-26c6-46e3-af65-342dadd13e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061e8e1a4dfc4104adf11472736be95f, user_id=12463c41270648a3b7c474c83f417c75, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:41.381577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508e456-26c6-46e3-af65-342dadd13e66 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:41.397968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1084/2161] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:41 2022] PUT /identity/v3/projects/061e8e1a4dfc4104adf11472736be95f/users/12463c41270648a3b7c474c83f417c75/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:41.406990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017397b2-3409-4597-9cbf-cc60fcdfc4bf None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:41.407604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017397b2-3409-4597-9cbf-cc60fcdfc4bf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:41.407731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017397b2-3409-4597-9cbf-cc60fcdfc4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:41.441880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-017397b2-3409-4597-9cbf-cc60fcdfc4bf None None] MFA Rules not processed for user `12463c41270648a3b7c474c83f417c75`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:41.443522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-017397b2-3409-4597-9cbf-cc60fcdfc4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:41.597639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1078/2162] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:41.606172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e456-26c6-46e3-af65-342dadd13e66 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:41.608781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c508e456-26c6-46e3-af65-342dadd13e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:41.806657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e456-26c6-46e3-af65-342dadd13e66 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:41.818742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d282300-a146-432a-a707-67bb25656bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:41.820592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d282300-a146-432a-a707-67bb25656bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:41.820881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d282300-a146-432a-a707-67bb25656bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:41.821296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d282300-a146-432a-a707-67bb25656bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:41.848807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d282300-a146-432a-a707-67bb25656bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:41.850412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d282300-a146-432a-a707-67bb25656bd6 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:41.877971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1085/2163] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:42.092096 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017397b2-3409-4597-9cbf-cc60fcdfc4bf None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:42.105500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017397b2-3409-4597-9cbf-cc60fcdfc4bf None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:42.116973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f86c06-19a5-46de-bde9-15c86ecb08cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:42.117991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f86c06-19a5-46de-bde9-15c86ecb08cf service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:42.118093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f86c06-19a5-46de-bde9-15c86ecb08cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:42.118402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f86c06-19a5-46de-bde9-15c86ecb08cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:42.221040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f86c06-19a5-46de-bde9-15c86ecb08cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:42.222443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f86c06-19a5-46de-bde9-15c86ecb08cf service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:42.236399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1079/2164] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:42.912936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cd938-9ae9-45f4-baee-5460f2503b7a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:42.913540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cd938-9ae9-45f4-baee-5460f2503b7a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:42.913540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cd938-9ae9-45f4-baee-5460f2503b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:42.942739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-642cd938-9ae9-45f4-baee-5460f2503b7a None None] MFA Rules not processed for user `5935e6b505174f0c9a437b303bbbf24f`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:42.943993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-642cd938-9ae9-45f4-baee-5460f2503b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:43.029340 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1086/2165] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:43.036805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f86c06-19a5-46de-bde9-15c86ecb08cf service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:43.038238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-91f86c06-19a5-46de-bde9-15c86ecb08cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:43.127704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f86c06-19a5-46de-bde9-15c86ecb08cf service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:43.134896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856b8ae-b05a-4ac4-b974-b046000e6736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:43.135507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856b8ae-b05a-4ac4-b974-b046000e6736 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:43.135853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856b8ae-b05a-4ac4-b974-b046000e6736 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:43.136202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856b8ae-b05a-4ac4-b974-b046000e6736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:43.138168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4856b8ae-b05a-4ac4-b974-b046000e6736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:43.146158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:43.301552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856b8ae-b05a-4ac4-b974-b046000e6736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:43.306527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856b8ae-b05a-4ac4-b974-b046000e6736 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:43.317895 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1080/2166] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:13:44.654333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc303555-81f3-4705-96b8-f8692daefc86 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:44.655492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc303555-81f3-4705-96b8-f8692daefc86 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:44.655758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc303555-81f3-4705-96b8-f8692daefc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:44.688783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cc303555-81f3-4705-96b8-f8692daefc86 None None] MFA Rules not processed for user `cd2edb3eefa5428e97b4742d70f719b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:44.690113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cc303555-81f3-4705-96b8-f8692daefc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:44.698135 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1087/2167] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:47.615496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856b8ae-b05a-4ac4-b974-b046000e6736 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:47.713269 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856b8ae-b05a-4ac4-b974-b046000e6736 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:47.719054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:47.719812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:47.720385 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:47.720653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] PATH_INFO: `/v3/users/fe90b66546f1484e981724556840da59` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:47.721957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe90b66546f1484e981724556840da59)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:47.723995 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:47.785765 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe90b66546f1484e981724556840da59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:47.799636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe90b66546f1484e981724556840da59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:47.800524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe90b66546f1484e981724556840da59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:47.801256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe90b66546f1484e981724556840da59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:47.821340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe90b66546f1484e981724556840da59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:47.882919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1081/2168] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:47 2022] DELETE /identity/v3/users/fe90b66546f1484e981724556840da59 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:47.884978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8f911-296a-43d4-bdf4-e172c2cfc7ab None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:47.885496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8f911-296a-43d4-bdf4-e172c2cfc7ab None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:47.885598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8f911-296a-43d4-bdf4-e172c2cfc7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:47.924356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-acc8f911-296a-43d4-bdf4-e172c2cfc7ab None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:47.925851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-acc8f911-296a-43d4-bdf4-e172c2cfc7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:48.084320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1088/2169] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:48.096550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:48.098317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:48.163087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:48.235811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96ba6-bc30-447d-b3ad-6b5068f673b2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:48.239730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a69b7-95b7-4693-9a11-af634bc865b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:48.240383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a69b7-95b7-4693-9a11-af634bc865b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:48.240660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a69b7-95b7-4693-9a11-af634bc865b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:48.240937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a69b7-95b7-4693-9a11-af634bc865b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:48.255914 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a69b7-95b7-4693-9a11-af634bc865b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:48.257769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a69b7-95b7-4693-9a11-af634bc865b9 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:48.269094 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1082/2170] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:48.674949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8f911-296a-43d4-bdf4-e172c2cfc7ab None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:48.676403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-acc8f911-296a-43d4-bdf4-e172c2cfc7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:48.692421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8f911-296a-43d4-bdf4-e172c2cfc7ab None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:48.698038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:48.699043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:48.699501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:48.699931 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] PATH_INFO: `/v3/projects/65935356afb846ee83fee05e48423d63` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:48.702030 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65935356afb846ee83fee05e48423d63)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:48.703516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:48.712334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:48.762181 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65935356afb846ee83fee05e48423d63', 'request_id': 'req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:48.768032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65935356afb846ee83fee05e48423d63', 'request_id': 'req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:48.775913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65935356afb846ee83fee05e48423d63', 'request_id': 'req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:48.788376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] The token cache is being invalidate because project 65935356afb846ee83fee05e48423d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:48.788816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:48.789485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:48.791051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1089/2171] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:48 2022] DELETE /identity/v3/projects/65935356afb846ee83fee05e48423d63 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:48.794867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a69b7-95b7-4693-9a11-af634bc865b9 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:48.805797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a69b7-95b7-4693-9a11-af634bc865b9 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:48.871896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:48.873025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:48.874322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:48.875038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] PATH_INFO: `/v3/users/12463c41270648a3b7c474c83f417c75` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:48.876713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12463c41270648a3b7c474c83f417c75)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:48.878924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:48.941681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12463c41270648a3b7c474c83f417c75'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:48.952747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12463c41270648a3b7c474c83f417c75'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:48.953893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12463c41270648a3b7c474c83f417c75'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:48.954660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12463c41270648a3b7c474c83f417c75'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:48.968515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7f9b62d0-e0a0-499f-86cd-8fb919570188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12463c41270648a3b7c474c83f417c75'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:48.995611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1083/2172] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:48 2022] DELETE /identity/v3/users/12463c41270648a3b7c474c83f417c75 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:49.329626 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:49.331584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:49.346674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26978a-8d11-4fb1-bcfb-3e8121c5bf80 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:49.444782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:49.446699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:49.447242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:49.447765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] PATH_INFO: `/v3/projects/061e8e1a4dfc4104adf11472736be95f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:49.452984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=061e8e1a4dfc4104adf11472736be95f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:49.465091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:49.537768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061e8e1a4dfc4104adf11472736be95f', 'request_id': 'req-40520b0a-de74-4150-a9c0-7f781af87e62'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:49.544248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061e8e1a4dfc4104adf11472736be95f', 'request_id': 'req-40520b0a-de74-4150-a9c0-7f781af87e62'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:49.558071 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061e8e1a4dfc4104adf11472736be95f', 'request_id': 'req-40520b0a-de74-4150-a9c0-7f781af87e62'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:49.572359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] The token cache is being invalidate because project 061e8e1a4dfc4104adf11472736be95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:49.572652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:49.573483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-40520b0a-de74-4150-a9c0-7f781af87e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:49.575016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1090/2173] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:49 2022] DELETE /identity/v3/projects/061e8e1a4dfc4104adf11472736be95f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:49.580129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066241bd-7334-4144-8379-1e7af70cb32e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:49.580469 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066241bd-7334-4144-8379-1e7af70cb32e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:49.580748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066241bd-7334-4144-8379-1e7af70cb32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:49.608664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-066241bd-7334-4144-8379-1e7af70cb32e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:49.610685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-066241bd-7334-4144-8379-1e7af70cb32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:49.692837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:49.717675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1084/2174] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:49.719811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c79f4-296d-4811-84f4-cb75e2bfd557 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:49.720490 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c79f4-296d-4811-84f4-cb75e2bfd557 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:49.720958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c79f4-296d-4811-84f4-cb75e2bfd557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:49.756797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6b9c79f4-296d-4811-84f4-cb75e2bfd557 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:49.758809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6b9c79f4-296d-4811-84f4-cb75e2bfd557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:49.768405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1091/2175] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:49.772898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066241bd-7334-4144-8379-1e7af70cb32e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:49.788780 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066241bd-7334-4144-8379-1e7af70cb32e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:49.794117 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c02316-933b-4448-99a5-29772885e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:49.794775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c02316-933b-4448-99a5-29772885e0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:49.795072 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c02316-933b-4448-99a5-29772885e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:49.796189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c02316-933b-4448-99a5-29772885e0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:49.796705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c02316-933b-4448-99a5-29772885e0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:49.797013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c02316-933b-4448-99a5-29772885e0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:49.798715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c02316-933b-4448-99a5-29772885e0b6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:49.818214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1085/2176] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:13:49.822444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c79f4-296d-4811-84f4-cb75e2bfd557 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:49.847125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c79f4-296d-4811-84f4-cb75e2bfd557 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:49.852567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e008c-70f7-440f-a331-bdad821609b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:49.853214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e008c-70f7-440f-a331-bdad821609b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:49.853559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e008c-70f7-440f-a331-bdad821609b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:49.853947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e008c-70f7-440f-a331-bdad821609b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:49.855083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e008c-70f7-440f-a331-bdad821609b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:49.856869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e008c-70f7-440f-a331-bdad821609b6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:49.896311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:49.911089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1092/2177] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:49 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:49.912602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c02316-933b-4448-99a5-29772885e0b6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:49.926041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c02316-933b-4448-99a5-29772885e0b6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:50.032330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803521b-a64a-43dd-983d-d5cb37542cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:50.032988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803521b-a64a-43dd-983d-d5cb37542cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:50.033268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803521b-a64a-43dd-983d-d5cb37542cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:50.033700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803521b-a64a-43dd-983d-d5cb37542cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:50.035378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803521b-a64a-43dd-983d-d5cb37542cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:50.037431 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803521b-a64a-43dd-983d-d5cb37542cc9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:50.066056 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1086/2178] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:49 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:50.070430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e008c-70f7-440f-a331-bdad821609b6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:50.083433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e008c-70f7-440f-a331-bdad821609b6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:50.088339 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c41a9-b7d2-4a10-92da-b4c4ee42659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:50.088945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c41a9-b7d2-4a10-92da-b4c4ee42659c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:50.089221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c41a9-b7d2-4a10-92da-b4c4ee42659c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:50.089496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c41a9-b7d2-4a10-92da-b4c4ee42659c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:50.090176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c41a9-b7d2-4a10-92da-b4c4ee42659c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:50.091916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c41a9-b7d2-4a10-92da-b4c4ee42659c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:50.109192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1093/2179] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:50.110485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803521b-a64a-43dd-983d-d5cb37542cc9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:50.126125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803521b-a64a-43dd-983d-d5cb37542cc9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:50.133577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39d67c-42cc-407f-b60e-21aedc34eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:50.134785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39d67c-42cc-407f-b60e-21aedc34eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:50.135301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39d67c-42cc-407f-b60e-21aedc34eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:50.135703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39d67c-42cc-407f-b60e-21aedc34eb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:50.136514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39d67c-42cc-407f-b60e-21aedc34eb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:50.138250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39d67c-42cc-407f-b60e-21aedc34eb09 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:50.160190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1087/2180] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:50.170963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c41a9-b7d2-4a10-92da-b4c4ee42659c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:50.184139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c41a9-b7d2-4a10-92da-b4c4ee42659c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:50.189743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e3ae-f7ec-42cd-8fb8-2ccdd5cd830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:50.191933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e3ae-f7ec-42cd-8fb8-2ccdd5cd830a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:50.191933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e3ae-f7ec-42cd-8fb8-2ccdd5cd830a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:50.191933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e3ae-f7ec-42cd-8fb8-2ccdd5cd830a admin admin] PATH_INFO: `/v3/projects/1ff6cd192f9b46518ed244437922fe97/users/ca325125770b416ea4a09d892eb7e713/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:50.219895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64e3ae-f7ec-42cd-8fb8-2ccdd5cd830a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff6cd192f9b46518ed244437922fe97, user_id=ca325125770b416ea4a09d892eb7e713, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:50.223630 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64e3ae-f7ec-42cd-8fb8-2ccdd5cd830a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:50.241849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1094/2181] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:50 2022] PUT /identity/v3/projects/1ff6cd192f9b46518ed244437922fe97/users/ca325125770b416ea4a09d892eb7e713/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:50.253546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164374-d853-4abc-a526-1ddce5a8cf07 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:50.253546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164374-d853-4abc-a526-1ddce5a8cf07 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:50.253546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164374-d853-4abc-a526-1ddce5a8cf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:50.306405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7c164374-d853-4abc-a526-1ddce5a8cf07 None None] MFA Rules not processed for user `ca325125770b416ea4a09d892eb7e713`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:50.307683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7c164374-d853-4abc-a526-1ddce5a8cf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:50.450024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1088/2182] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:50.455011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e3ae-f7ec-42cd-8fb8-2ccdd5cd830a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:50.457496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8c64e3ae-f7ec-42cd-8fb8-2ccdd5cd830a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:50.594555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e3ae-f7ec-42cd-8fb8-2ccdd5cd830a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:50.599167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a412bbb-6a26-4536-967b-a5c9ad3bb4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:50.600063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412bbb-6a26-4536-967b-a5c9ad3bb4aa service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:50.600513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412bbb-6a26-4536-967b-a5c9ad3bb4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:50.601132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412bbb-6a26-4536-967b-a5c9ad3bb4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:50.615055 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a412bbb-6a26-4536-967b-a5c9ad3bb4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:50.616916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c164374-d853-4abc-a526-1ddce5a8cf07 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:50.617499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a412bbb-6a26-4536-967b-a5c9ad3bb4aa service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:50.623713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7c164374-d853-4abc-a526-1ddce5a8cf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:50.628454 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1095/2183] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:50.715841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:50.766440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c164374-d853-4abc-a526-1ddce5a8cf07 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:50.778170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:50.778170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:50.778170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:50.778170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] PATH_INFO: `/v3/users/79c0f71256b849ada94112bb60603064` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:50.780162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c0f71256b849ada94112bb60603064)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:50.781383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:50.878485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c0f71256b849ada94112bb60603064'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:50.894825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c0f71256b849ada94112bb60603064'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:50.899283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c0f71256b849ada94112bb60603064'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:50.900719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c0f71256b849ada94112bb60603064'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:50.919622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c0f71256b849ada94112bb60603064'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:50.948512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1089/2184] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:50 2022] DELETE /identity/v3/users/79c0f71256b849ada94112bb60603064 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:51.219890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a412bbb-6a26-4536-967b-a5c9ad3bb4aa service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:51.233649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a412bbb-6a26-4536-967b-a5c9ad3bb4aa service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:51.304158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:51.304936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:51.305214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:51.305486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] PATH_INFO: `/v3/projects/2424eae4edc34d898d8803b287f88b8a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:51.306796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=2424eae4edc34d898d8803b287f88b8a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:51.311531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:51.372035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2424eae4edc34d898d8803b287f88b8a', 'request_id': 'req-24d0e9da-282e-4a6c-9028-afcabfcb5ded'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.378949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2424eae4edc34d898d8803b287f88b8a', 'request_id': 'req-24d0e9da-282e-4a6c-9028-afcabfcb5ded'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.387308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2424eae4edc34d898d8803b287f88b8a', 'request_id': 'req-24d0e9da-282e-4a6c-9028-afcabfcb5ded'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.390047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:51.404037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] The token cache is being invalidate because project 2424eae4edc34d898d8803b287f88b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:51.404328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.405782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.409655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1096/2185] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:51 2022] DELETE /identity/v3/projects/2424eae4edc34d898d8803b287f88b8a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:51.411587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:51.413040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:51.428847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c0eeb-b2fb-4c12-a1de-b273820cae2d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:51.487919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:51.488560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:51.488849 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:51.489126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] PATH_INFO: `/v3/users/8f75b6daf2764ed89d97d64b67e071e8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:51.490275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f75b6daf2764ed89d97d64b67e071e8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:51.492194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:51.539900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f75b6daf2764ed89d97d64b67e071e8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.548343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f75b6daf2764ed89d97d64b67e071e8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.549433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f75b6daf2764ed89d97d64b67e071e8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.550090 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f75b6daf2764ed89d97d64b67e071e8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.558446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4485e86e-64d8-4205-9a61-2d7ddf5ca21d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f75b6daf2764ed89d97d64b67e071e8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.560882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:51.580646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1090/2186] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:51 2022] DELETE /identity/v3/users/8f75b6daf2764ed89d97d64b67e071e8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:51.776828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:51.778909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:51.795911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0e9da-282e-4a6c-9028-afcabfcb5ded admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:51.858399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:51.859031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:51.859317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:51.859597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] PATH_INFO: `/v3/projects/713667c3c7ee4c1cba6e0b2872d2d133` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:51.860722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713667c3c7ee4c1cba6e0b2872d2d133)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:51.862663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:51.910778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713667c3c7ee4c1cba6e0b2872d2d133', 'request_id': 'req-cd512095-90ec-4386-a4dd-ab870038d7f8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.917399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713667c3c7ee4c1cba6e0b2872d2d133', 'request_id': 'req-cd512095-90ec-4386-a4dd-ab870038d7f8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.925258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713667c3c7ee4c1cba6e0b2872d2d133', 'request_id': 'req-cd512095-90ec-4386-a4dd-ab870038d7f8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.938347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] The token cache is being invalidate because project 713667c3c7ee4c1cba6e0b2872d2d133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:51.938630 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.939334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd512095-90ec-4386-a4dd-ab870038d7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:51.940964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1097/2187] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:51 2022] DELETE /identity/v3/projects/713667c3c7ee4c1cba6e0b2872d2d133 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:51.946942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4a0dc-3ef8-4104-a518-a14646405cf4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:51.947430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4a0dc-3ef8-4104-a518-a14646405cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:51.947531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4a0dc-3ef8-4104-a518-a14646405cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:51.974552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f0e4a0dc-3ef8-4104-a518-a14646405cf4 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:51.975783 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f0e4a0dc-3ef8-4104-a518-a14646405cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:52.048850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1091/2188] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:52.056884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be24b1e-69a8-441c-bf37-b4d462cdfcd2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:52.057247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be24b1e-69a8-441c-bf37-b4d462cdfcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:52.057522 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be24b1e-69a8-441c-bf37-b4d462cdfcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:52.078549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1be24b1e-69a8-441c-bf37-b4d462cdfcd2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:52.079762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1be24b1e-69a8-441c-bf37-b4d462cdfcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:52.088659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1098/2189] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:52.093893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4a0dc-3ef8-4104-a518-a14646405cf4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:52.103552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4a0dc-3ef8-4104-a518-a14646405cf4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:52.109378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59220a19-10fb-4312-82c5-e95e3fc4c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:52.110026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59220a19-10fb-4312-82c5-e95e3fc4c46a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:52.110359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59220a19-10fb-4312-82c5-e95e3fc4c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:52.110651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59220a19-10fb-4312-82c5-e95e3fc4c46a admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:52.111335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59220a19-10fb-4312-82c5-e95e3fc4c46a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:52.111640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59220a19-10fb-4312-82c5-e95e3fc4c46a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:52.113221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59220a19-10fb-4312-82c5-e95e3fc4c46a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:52.125077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1092/2190] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:13:52.129637 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be24b1e-69a8-441c-bf37-b4d462cdfcd2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:52.138787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be24b1e-69a8-441c-bf37-b4d462cdfcd2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:52.143550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e44739-3979-4711-884c-f1cfa35ee76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:52.144160 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44739-3979-4711-884c-f1cfa35ee76b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:52.144451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44739-3979-4711-884c-f1cfa35ee76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:52.144688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44739-3979-4711-884c-f1cfa35ee76b admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:52.145335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e44739-3979-4711-884c-f1cfa35ee76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:52.147351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e44739-3979-4711-884c-f1cfa35ee76b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:52.177846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1099/2191] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:52 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:52.182289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59220a19-10fb-4312-82c5-e95e3fc4c46a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:52.193305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59220a19-10fb-4312-82c5-e95e3fc4c46a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:52.254674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fbc19-ae03-482d-afae-d3d453ba4c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:52.255391 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fbc19-ae03-482d-afae-d3d453ba4c4b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:52.255676 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fbc19-ae03-482d-afae-d3d453ba4c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:52.255952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fbc19-ae03-482d-afae-d3d453ba4c4b admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:52.256615 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fbc19-ae03-482d-afae-d3d453ba4c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:52.258620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fbc19-ae03-482d-afae-d3d453ba4c4b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:52.282848 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1093/2192] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:52 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:52.287857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e44739-3979-4711-884c-f1cfa35ee76b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:52.301493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e44739-3979-4711-884c-f1cfa35ee76b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:52.310210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478740-620a-41fe-ba8b-67a0e78237ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:52.310905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478740-620a-41fe-ba8b-67a0e78237ab admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:52.311309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478740-620a-41fe-ba8b-67a0e78237ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:52.311787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478740-620a-41fe-ba8b-67a0e78237ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:52.312738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12478740-620a-41fe-ba8b-67a0e78237ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:52.314499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12478740-620a-41fe-ba8b-67a0e78237ab admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:52.329510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1100/2193] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:52.331231 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fbc19-ae03-482d-afae-d3d453ba4c4b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:52.344318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fbc19-ae03-482d-afae-d3d453ba4c4b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:52.349571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd58d-deb9-4610-8b39-062ab759632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:52.350233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd58d-deb9-4610-8b39-062ab759632e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:52.350492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd58d-deb9-4610-8b39-062ab759632e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:52.350749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd58d-deb9-4610-8b39-062ab759632e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:52.351648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd58d-deb9-4610-8b39-062ab759632e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:52.353303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd58d-deb9-4610-8b39-062ab759632e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:52.369337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1094/2194] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:52.373489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478740-620a-41fe-ba8b-67a0e78237ab admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:52.388972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478740-620a-41fe-ba8b-67a0e78237ab admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:52.402687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddc3e2-3e99-4293-8abd-1a161976b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:52.403361 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddc3e2-3e99-4293-8abd-1a161976b2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:52.403644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddc3e2-3e99-4293-8abd-1a161976b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:52.403924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddc3e2-3e99-4293-8abd-1a161976b2f6 admin admin] PATH_INFO: `/v3/projects/3439513ebb784916aa472900e15eb79f/users/f321a050a58941938db5671890fbd0a0/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:52.424179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddc3e2-3e99-4293-8abd-1a161976b2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3439513ebb784916aa472900e15eb79f, user_id=f321a050a58941938db5671890fbd0a0, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:52.427199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddc3e2-3e99-4293-8abd-1a161976b2f6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:52.448626 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1101/2195] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:52 2022] PUT /identity/v3/projects/3439513ebb784916aa472900e15eb79f/users/f321a050a58941938db5671890fbd0a0/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:52.459943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93368-9adc-44c2-8e68-3367fbd06c98 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:52.460237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93368-9adc-44c2-8e68-3367fbd06c98 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:52.460563 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93368-9adc-44c2-8e68-3367fbd06c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:52.492640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6bd93368-9adc-44c2-8e68-3367fbd06c98 None None] MFA Rules not processed for user `f321a050a58941938db5671890fbd0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:52.493898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6bd93368-9adc-44c2-8e68-3367fbd06c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:52.536265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:52.576898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1095/2196] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:53.100203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddc3e2-3e99-4293-8abd-1a161976b2f6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:53.104768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93368-9adc-44c2-8e68-3367fbd06c98 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:53.105156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2eddc3e2-3e99-4293-8abd-1a161976b2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:53.106447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6bd93368-9adc-44c2-8e68-3367fbd06c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:53.134960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:53.170899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddc3e2-3e99-4293-8abd-1a161976b2f6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:53.174788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9eb8ab-cff3-4f8e-a325-7932ecb0e8b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f20fbf033f04036b48194a804dae8c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:53.175505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9eb8ab-cff3-4f8e-a325-7932ecb0e8b4 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:53.175801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9eb8ab-cff3-4f8e-a325-7932ecb0e8b4 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:53.176086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9eb8ab-cff3-4f8e-a325-7932ecb0e8b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:53.184864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93368-9adc-44c2-8e68-3367fbd06c98 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:53.185056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9eb8ab-cff3-4f8e-a325-7932ecb0e8b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:53.187103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9eb8ab-cff3-4f8e-a325-7932ecb0e8b4 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:53.190191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:53.190828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:53.191107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:53.191407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] PATH_INFO: `/v3/users/df04a265f9294b43b6198a6127b1bb58` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:53.192532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df04a265f9294b43b6198a6127b1bb58)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:53.194462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:53.196170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1102/2197] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:53.245555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df04a265f9294b43b6198a6127b1bb58'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:53.259248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df04a265f9294b43b6198a6127b1bb58'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:53.259872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df04a265f9294b43b6198a6127b1bb58'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:53.260590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df04a265f9294b43b6198a6127b1bb58'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:53.268875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df04a265f9294b43b6198a6127b1bb58'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:53.286865 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1096/2198] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:53 2022] DELETE /identity/v3/users/df04a265f9294b43b6198a6127b1bb58 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:53.291317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8a30-18ae-450a-8b54-3777d050be10 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:53.291607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8a30-18ae-450a-8b54-3777d050be10 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:53.291882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8a30-18ae-450a-8b54-3777d050be10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:53.313198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-234a8a30-18ae-450a-8b54-3777d050be10 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:53.314601 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-234a8a30-18ae-450a-8b54-3777d050be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:53.377914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1103/2199] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:53.388614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:53.390757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:53.473995 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbcd66-cf1c-4921-8997-d130420b2699 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:53.478175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bda8f9-7441-498f-92a9-a33bf6618236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:53.478847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bda8f9-7441-498f-92a9-a33bf6618236 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:53.479395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bda8f9-7441-498f-92a9-a33bf6618236 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:53.479506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bda8f9-7441-498f-92a9-a33bf6618236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:53.491959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bda8f9-7441-498f-92a9-a33bf6618236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:53.493431 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bda8f9-7441-498f-92a9-a33bf6618236 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:53.500441 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:53.509795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1097/2200] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:54.106329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8a30-18ae-450a-8b54-3777d050be10 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:54.107810 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-234a8a30-18ae-450a-8b54-3777d050be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:54.124966 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8a30-18ae-450a-8b54-3777d050be10 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:54.129649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:54.130297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:54.130575 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:54.130919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] PATH_INFO: `/v3/projects/52b390b0ef0a452d9eee41d1c3034fca` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:54.131959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b390b0ef0a452d9eee41d1c3034fca)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:54.133889 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:54.181859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b390b0ef0a452d9eee41d1c3034fca', 'request_id': 'req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.187527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b390b0ef0a452d9eee41d1c3034fca', 'request_id': 'req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.195613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b390b0ef0a452d9eee41d1c3034fca', 'request_id': 'req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.207796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] The token cache is being invalidate because project 52b390b0ef0a452d9eee41d1c3034fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:54.208085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.208769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.210418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1104/2201] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:54 2022] DELETE /identity/v3/projects/52b390b0ef0a452d9eee41d1c3034fca => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:54.214402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bda8f9-7441-498f-92a9-a33bf6618236 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:54.225322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bda8f9-7441-498f-92a9-a33bf6618236 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:54.284580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:54.285210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:54.285490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:54.285801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] PATH_INFO: `/v3/users/2c9d338e8667421cb22172f586d286eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:54.286898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9d338e8667421cb22172f586d286eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:54.288839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:54.334658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9d338e8667421cb22172f586d286eb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.343046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9d338e8667421cb22172f586d286eb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.343878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9d338e8667421cb22172f586d286eb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.344491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9d338e8667421cb22172f586d286eb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.356042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c5cc14dc-7251-4701-a26a-6c8cd7305bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9d338e8667421cb22172f586d286eb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.374607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1098/2202] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:54 2022] DELETE /identity/v3/users/2c9d338e8667421cb22172f586d286eb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:54.659943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:54.661548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:54.675653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe44c7f-8e23-4fc5-a5d0-887f000e14fa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:54.747153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:54.767734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:54.768453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:54.768738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:54.769082 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] PATH_INFO: `/v3/projects/e302b47cb1434e89ad8b29823a48387e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:54.770359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e302b47cb1434e89ad8b29823a48387e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:54.772483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:54.840642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e302b47cb1434e89ad8b29823a48387e', 'request_id': 'req-6c74fdf1-c73b-4e43-be79-94b959049fb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.848313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e302b47cb1434e89ad8b29823a48387e', 'request_id': 'req-6c74fdf1-c73b-4e43-be79-94b959049fb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.856863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e302b47cb1434e89ad8b29823a48387e', 'request_id': 'req-6c74fdf1-c73b-4e43-be79-94b959049fb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.868820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] The token cache is being invalidate because project e302b47cb1434e89ad8b29823a48387e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:54.869226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.869935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6c74fdf1-c73b-4e43-be79-94b959049fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:54.871509 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1105/2203] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:54 2022] DELETE /identity/v3/projects/e302b47cb1434e89ad8b29823a48387e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:54.877198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d72877-68ee-40f8-a94e-cbaf268cfa60 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:54.877486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d72877-68ee-40f8-a94e-cbaf268cfa60 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:54.877797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d72877-68ee-40f8-a94e-cbaf268cfa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:54.897835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c7d72877-68ee-40f8-a94e-cbaf268cfa60 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:54.899019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c7d72877-68ee-40f8-a94e-cbaf268cfa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:54.959962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1099/2204] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:54.968486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70769f30-9bd6-4ba5-a2c7-25441a1f1e8d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:54.968774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70769f30-9bd6-4ba5-a2c7-25441a1f1e8d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:54.969050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70769f30-9bd6-4ba5-a2c7-25441a1f1e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:54.990078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-70769f30-9bd6-4ba5-a2c7-25441a1f1e8d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:54.991620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-70769f30-9bd6-4ba5-a2c7-25441a1f1e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:55.007101 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1106/2205] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:55.011298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d72877-68ee-40f8-a94e-cbaf268cfa60 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.021897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d72877-68ee-40f8-a94e-cbaf268cfa60 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.026594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066fe3-7b66-4c4a-af11-a60857a22c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.027198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066fe3-7b66-4c4a-af11-a60857a22c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.027479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066fe3-7b66-4c4a-af11-a60857a22c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.027752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066fe3-7b66-4c4a-af11-a60857a22c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.028390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb066fe3-7b66-4c4a-af11-a60857a22c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:55.028690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb066fe3-7b66-4c4a-af11-a60857a22c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.030426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb066fe3-7b66-4c4a-af11-a60857a22c63 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.042191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1100/2206] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:13:55.047265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70769f30-9bd6-4ba5-a2c7-25441a1f1e8d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.056862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70769f30-9bd6-4ba5-a2c7-25441a1f1e8d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.061474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f182a-e3a4-47ab-91a7-83d01999470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.062113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f182a-e3a4-47ab-91a7-83d01999470e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.062396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f182a-e3a4-47ab-91a7-83d01999470e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.062666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f182a-e3a4-47ab-91a7-83d01999470e admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.063307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f182a-e3a4-47ab-91a7-83d01999470e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.065236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f182a-e3a4-47ab-91a7-83d01999470e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.094308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1107/2207] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:55 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:55.102333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066fe3-7b66-4c4a-af11-a60857a22c63 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.114026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066fe3-7b66-4c4a-af11-a60857a22c63 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.118282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:55.187397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d601db4-e711-4c61-9602-9aa652c2a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.188006 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601db4-e711-4c61-9602-9aa652c2a66e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.188319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601db4-e711-4c61-9602-9aa652c2a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.188580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601db4-e711-4c61-9602-9aa652c2a66e admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.189210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d601db4-e711-4c61-9602-9aa652c2a66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.191166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d601db4-e711-4c61-9602-9aa652c2a66e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.216158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1101/2208] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:55 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:55.218431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f182a-e3a4-47ab-91a7-83d01999470e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.229215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f182a-e3a4-47ab-91a7-83d01999470e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.234117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db7858-7d3c-4ed6-8a0b-09eb36d107e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.234707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db7858-7d3c-4ed6-8a0b-09eb36d107e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.234986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db7858-7d3c-4ed6-8a0b-09eb36d107e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.235252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db7858-7d3c-4ed6-8a0b-09eb36d107e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.235888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db7858-7d3c-4ed6-8a0b-09eb36d107e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.237503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db7858-7d3c-4ed6-8a0b-09eb36d107e4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.247326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1108/2209] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:13:55.251965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d601db4-e711-4c61-9602-9aa652c2a66e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.262382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d601db4-e711-4c61-9602-9aa652c2a66e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.267856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9251c-4540-44ef-8607-b4c96df66b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.268473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9251c-4540-44ef-8607-b4c96df66b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.268757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9251c-4540-44ef-8607-b4c96df66b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.269029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9251c-4540-44ef-8607-b4c96df66b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.269699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9251c-4540-44ef-8607-b4c96df66b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.271306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9251c-4540-44ef-8607-b4c96df66b32 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.286319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1102/2210] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:55.287874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db7858-7d3c-4ed6-8a0b-09eb36d107e4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.299587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db7858-7d3c-4ed6-8a0b-09eb36d107e4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.304402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c43577-25e4-47cb-bb91-33346fdce681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.305052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c43577-25e4-47cb-bb91-33346fdce681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.305333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c43577-25e4-47cb-bb91-33346fdce681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.305605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c43577-25e4-47cb-bb91-33346fdce681 admin admin] PATH_INFO: `/v3/projects/beaca7f9a6ee4e6cb253b2bb235bf3f1/users/5934350e142341f4ae1db56d2e60d1c3/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.320578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c43577-25e4-47cb-bb91-33346fdce681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beaca7f9a6ee4e6cb253b2bb235bf3f1, user_id=5934350e142341f4ae1db56d2e60d1c3, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.323267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c43577-25e4-47cb-bb91-33346fdce681 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.337221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1109/2211] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:55 2022] PUT /identity/v3/projects/beaca7f9a6ee4e6cb253b2bb235bf3f1/users/5934350e142341f4ae1db56d2e60d1c3/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:55.348487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03766cd9-b68c-4bee-8327-3375878f69f7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.348771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03766cd9-b68c-4bee-8327-3375878f69f7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.349045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03766cd9-b68c-4bee-8327-3375878f69f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.377695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-03766cd9-b68c-4bee-8327-3375878f69f7 None None] MFA Rules not processed for user `5934350e142341f4ae1db56d2e60d1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:55.378962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-03766cd9-b68c-4bee-8327-3375878f69f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:55.446327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1103/2212] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:55.451431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c43577-25e4-47cb-bb91-33346fdce681 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.523018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c43577-25e4-47cb-bb91-33346fdce681 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.527569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe032-d56f-4da4-bc92-4f5a15d14910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.528166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe032-d56f-4da4-bc92-4f5a15d14910 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.528444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe032-d56f-4da4-bc92-4f5a15d14910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.528721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe032-d56f-4da4-bc92-4f5a15d14910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.529347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fe032-d56f-4da4-bc92-4f5a15d14910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.531350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fe032-d56f-4da4-bc92-4f5a15d14910 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.551838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:55.562089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1110/2213] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:55 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:55.563207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03766cd9-b68c-4bee-8327-3375878f69f7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.573901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03766cd9-b68c-4bee-8327-3375878f69f7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.628452 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af672f6f-49ad-4002-a260-f25ced6608da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.629049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af672f6f-49ad-4002-a260-f25ced6608da admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.629326 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af672f6f-49ad-4002-a260-f25ced6608da admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.629593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af672f6f-49ad-4002-a260-f25ced6608da admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.630236 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af672f6f-49ad-4002-a260-f25ced6608da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.632125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af672f6f-49ad-4002-a260-f25ced6608da admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.653348 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1104/2214] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:55 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:55.657728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe032-d56f-4da4-bc92-4f5a15d14910 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.667920 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe032-d56f-4da4-bc92-4f5a15d14910 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.673665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bef70-4276-4346-a11c-6083acbe3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.674273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bef70-4276-4346-a11c-6083acbe3b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.674549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bef70-4276-4346-a11c-6083acbe3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.674866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bef70-4276-4346-a11c-6083acbe3b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.675498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bef70-4276-4346-a11c-6083acbe3b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.677084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bef70-4276-4346-a11c-6083acbe3b71 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.688635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1111/2215] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:55.692815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af672f6f-49ad-4002-a260-f25ced6608da admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.699225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:55.703358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af672f6f-49ad-4002-a260-f25ced6608da admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.708984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba4a14-1461-4882-a771-d47aa9dea973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.709683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba4a14-1461-4882-a771-d47aa9dea973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.709972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba4a14-1461-4882-a771-d47aa9dea973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.710247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba4a14-1461-4882-a771-d47aa9dea973 admin admin] PATH_INFO: `/v3/projects/ea5200ad17fb4d6c901d1f4d18205ffe/users/b0c54cd0dada4ddd9e43ee8399b3583c/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.725106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba4a14-1461-4882-a771-d47aa9dea973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5200ad17fb4d6c901d1f4d18205ffe, user_id=b0c54cd0dada4ddd9e43ee8399b3583c, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.727779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba4a14-1461-4882-a771-d47aa9dea973 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.740993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1105/2216] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:55 2022] PUT /identity/v3/projects/ea5200ad17fb4d6c901d1f4d18205ffe/users/b0c54cd0dada4ddd9e43ee8399b3583c/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:55.744971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bef70-4276-4346-a11c-6083acbe3b71 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.756986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bef70-4276-4346-a11c-6083acbe3b71 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.816727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75723b1-0f45-4954-9f48-dc6c2b3003f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.817540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75723b1-0f45-4954-9f48-dc6c2b3003f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.817950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75723b1-0f45-4954-9f48-dc6c2b3003f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.818192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75723b1-0f45-4954-9f48-dc6c2b3003f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.825971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75723b1-0f45-4954-9f48-dc6c2b3003f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.828359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75723b1-0f45-4954-9f48-dc6c2b3003f8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.839542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1112/2217] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:55.843791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba4a14-1461-4882-a771-d47aa9dea973 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:55.858142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba4a14-1461-4882-a771-d47aa9dea973 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:55.866626 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db709d-8321-423d-b4fa-3c26babcc86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:55.867312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db709d-8321-423d-b4fa-3c26babcc86a admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.867594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db709d-8321-423d-b4fa-3c26babcc86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.867872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db709d-8321-423d-b4fa-3c26babcc86a admin admin] PATH_INFO: `/v3/projects/ea5200ad17fb4d6c901d1f4d18205ffe/users/b0c54cd0dada4ddd9e43ee8399b3583c/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.869911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db709d-8321-423d-b4fa-3c26babcc86a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5200ad17fb4d6c901d1f4d18205ffe, user_id=b0c54cd0dada4ddd9e43ee8399b3583c, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:55.872594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db709d-8321-423d-b4fa-3c26babcc86a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:55.884511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1106/2218] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:55 2022] PUT /identity/v3/projects/ea5200ad17fb4d6c901d1f4d18205ffe/users/b0c54cd0dada4ddd9e43ee8399b3583c/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:13:55.895381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17b383-a512-4e11-a228-6fdc2765c9cd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:55.895750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17b383-a512-4e11-a228-6fdc2765c9cd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:55.896148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17b383-a512-4e11-a228-6fdc2765c9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:55.930734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7f17b383-a512-4e11-a228-6fdc2765c9cd None None] MFA Rules not processed for user `b0c54cd0dada4ddd9e43ee8399b3583c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:55.932039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7f17b383-a512-4e11-a228-6fdc2765c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:56.007923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1113/2219] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:56.020810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db709d-8321-423d-b4fa-3c26babcc86a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:56.022635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-02db709d-8321-423d-b4fa-3c26babcc86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:56.083630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db709d-8321-423d-b4fa-3c26babcc86a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:56.087461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637a944-290d-4b99-aa76-073c0cd2b5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:56.088080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637a944-290d-4b99-aa76-073c0cd2b5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:56.088365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637a944-290d-4b99-aa76-073c0cd2b5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:56.088642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637a944-290d-4b99-aa76-073c0cd2b5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:56.098433 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637a944-290d-4b99-aa76-073c0cd2b5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:56.099857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637a944-290d-4b99-aa76-073c0cd2b5e5 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:56.109941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1107/2220] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:56.532806 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17b383-a512-4e11-a228-6fdc2765c9cd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:56.633748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17b383-a512-4e11-a228-6fdc2765c9cd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:56.646167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:56.647621 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:56.647932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:56.648237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] PATH_INFO: `/v3/users/5934350e142341f4ae1db56d2e60d1c3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:56.649567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5934350e142341f4ae1db56d2e60d1c3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:56.657702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:56.676346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:56.709093 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5934350e142341f4ae1db56d2e60d1c3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:56.716909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5934350e142341f4ae1db56d2e60d1c3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:56.718213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5934350e142341f4ae1db56d2e60d1c3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:56.718858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5934350e142341f4ae1db56d2e60d1c3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:56.725943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5934350e142341f4ae1db56d2e60d1c3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:56.744079 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1114/2221] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:56 2022] DELETE /identity/v3/users/5934350e142341f4ae1db56d2e60d1c3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:56.748866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127622-3ed8-4e57-8371-c89d0d7bf8fd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:56.749417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127622-3ed8-4e57-8371-c89d0d7bf8fd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:56.749707 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127622-3ed8-4e57-8371-c89d0d7bf8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:56.770487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0a127622-3ed8-4e57-8371-c89d0d7bf8fd None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:56.771703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0a127622-3ed8-4e57-8371-c89d0d7bf8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:56.832623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1108/2222] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:56.843398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:56.844795 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:56.914216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050bc0-046b-46b3-8199-d37361c89aec admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:56.919542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e9c8-e390-4e78-a9f1-a1f6bd5ef995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:56.919542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e9c8-e390-4e78-a9f1-a1f6bd5ef995 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:56.924468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e9c8-e390-4e78-a9f1-a1f6bd5ef995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:56.924468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e9c8-e390-4e78-a9f1-a1f6bd5ef995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:56.934337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569e9c8-e390-4e78-a9f1-a1f6bd5ef995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:56.935952 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569e9c8-e390-4e78-a9f1-a1f6bd5ef995 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:56.946834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1115/2223] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:13:57.219758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a127622-3ed8-4e57-8371-c89d0d7bf8fd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:57.221171 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0a127622-3ed8-4e57-8371-c89d0d7bf8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:57.236537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a127622-3ed8-4e57-8371-c89d0d7bf8fd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:57.241135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:57.241811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:57.242097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:57.242378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] PATH_INFO: `/v3/projects/beaca7f9a6ee4e6cb253b2bb235bf3f1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:57.243510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=beaca7f9a6ee4e6cb253b2bb235bf3f1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:57.245395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:57.292409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beaca7f9a6ee4e6cb253b2bb235bf3f1', 'request_id': 'req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.299595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beaca7f9a6ee4e6cb253b2bb235bf3f1', 'request_id': 'req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.305746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beaca7f9a6ee4e6cb253b2bb235bf3f1', 'request_id': 'req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.306925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:57.322272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] The token cache is being invalidate because project beaca7f9a6ee4e6cb253b2bb235bf3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:57.322584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.323340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.324910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1109/2224] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:57 2022] DELETE /identity/v3/projects/beaca7f9a6ee4e6cb253b2bb235bf3f1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:57.329709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e9c8-e390-4e78-a9f1-a1f6bd5ef995 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:57.339665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e9c8-e390-4e78-a9f1-a1f6bd5ef995 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:57.402857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:57.403487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:57.403769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:57.404052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] PATH_INFO: `/v3/users/b0c54cd0dada4ddd9e43ee8399b3583c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:57.405866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c54cd0dada4ddd9e43ee8399b3583c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:57.407941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:57.443720 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:57.454553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c54cd0dada4ddd9e43ee8399b3583c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.461815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c54cd0dada4ddd9e43ee8399b3583c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.462466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c54cd0dada4ddd9e43ee8399b3583c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.463085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c54cd0dada4ddd9e43ee8399b3583c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.470273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-488443a9-d39f-427a-86cb-0d1b2f83e943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c54cd0dada4ddd9e43ee8399b3583c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.487102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1116/2225] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:13:57 2022] DELETE /identity/v3/users/b0c54cd0dada4ddd9e43ee8399b3583c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:57.799837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:57.801427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:57.815581 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac09a2-8961-4a76-acdc-bfbecff7aa3b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:57.878830 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:57.879660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:57.879951 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:57.880221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] PATH_INFO: `/v3/projects/ea5200ad17fb4d6c901d1f4d18205ffe` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:57.881367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5200ad17fb4d6c901d1f4d18205ffe)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:57.883315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:57.964959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5200ad17fb4d6c901d1f4d18205ffe', 'request_id': 'req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.976788 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5200ad17fb4d6c901d1f4d18205ffe', 'request_id': 'req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.984680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5200ad17fb4d6c901d1f4d18205ffe', 'request_id': 'req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.997397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] The token cache is being invalidate because project ea5200ad17fb4d6c901d1f4d18205ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:13:57.997834 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:57.999047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc096fb8-4cf2-4e86-ae48-f560f2eacdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:13:58.000743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1110/2226] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:13:57 2022] DELETE /identity/v3/projects/ea5200ad17fb4d6c901d1f4d18205ffe => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:58.005472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0f63e-1185-4e5d-89d0-2d4781a2e96e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.005997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0f63e-1185-4e5d-89d0-2d4781a2e96e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.006092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0f63e-1185-4e5d-89d0-2d4781a2e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.039804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4ef0f63e-1185-4e5d-89d0-2d4781a2e96e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:58.041751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4ef0f63e-1185-4e5d-89d0-2d4781a2e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:58.150493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1117/2227] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:58.159674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc417-c8df-47be-a7f3-2e0b11608cb3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.160091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc417-c8df-47be-a7f3-2e0b11608cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.160373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc417-c8df-47be-a7f3-2e0b11608cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.186822 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-849dc417-c8df-47be-a7f3-2e0b11608cb3 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:58.188065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-849dc417-c8df-47be-a7f3-2e0b11608cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:58.211370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1111/2228] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:58.216266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0f63e-1185-4e5d-89d0-2d4781a2e96e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:58.230760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0f63e-1185-4e5d-89d0-2d4781a2e96e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:58.237707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf98031-2090-4425-9bf0-39a9121285e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:58.238327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf98031-2090-4425-9bf0-39a9121285e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.238614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf98031-2090-4425-9bf0-39a9121285e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.238890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf98031-2090-4425-9bf0-39a9121285e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.239551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf98031-2090-4425-9bf0-39a9121285e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:13:58.239849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf98031-2090-4425-9bf0-39a9121285e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:58.241459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf98031-2090-4425-9bf0-39a9121285e1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:58.260600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1118/2229] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:13:58.261800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dc417-c8df-47be-a7f3-2e0b11608cb3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:58.275435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dc417-c8df-47be-a7f3-2e0b11608cb3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:58.281152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce8ee6-8467-493d-8617-4d464b53b27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:58.282297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8ee6-8467-493d-8617-4d464b53b27e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.282297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8ee6-8467-493d-8617-4d464b53b27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.282564 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8ee6-8467-493d-8617-4d464b53b27e admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.283365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce8ee6-8467-493d-8617-4d464b53b27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:58.285315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce8ee6-8467-493d-8617-4d464b53b27e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:58.318097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1112/2230] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:58 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:58.322301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf98031-2090-4425-9bf0-39a9121285e1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:58.333749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf98031-2090-4425-9bf0-39a9121285e1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:58.403299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffdc13-4a23-4feb-ac19-4a869ab0d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:58.404035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffdc13-4a23-4feb-ac19-4a869ab0d07f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.404412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffdc13-4a23-4feb-ac19-4a869ab0d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.405352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffdc13-4a23-4feb-ac19-4a869ab0d07f admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.406487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffdc13-4a23-4feb-ac19-4a869ab0d07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:58.408758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffdc13-4a23-4feb-ac19-4a869ab0d07f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:58.454543 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1119/2231] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:58 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:58.455654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce8ee6-8467-493d-8617-4d464b53b27e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:58.469249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce8ee6-8467-493d-8617-4d464b53b27e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:58.475107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628faac-b08d-4cba-9b68-81720558795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:58.475325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628faac-b08d-4cba-9b68-81720558795e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.475675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628faac-b08d-4cba-9b68-81720558795e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.476023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628faac-b08d-4cba-9b68-81720558795e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.476725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628faac-b08d-4cba-9b68-81720558795e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:58.478439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628faac-b08d-4cba-9b68-81720558795e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:58.493653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1113/2232] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:58.495177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffdc13-4a23-4feb-ac19-4a869ab0d07f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:58.510029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffdc13-4a23-4feb-ac19-4a869ab0d07f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:58.518013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aeba0-3600-4872-ad4e-aa468625645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:58.519299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aeba0-3600-4872-ad4e-aa468625645e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.519828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aeba0-3600-4872-ad4e-aa468625645e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.520211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aeba0-3600-4872-ad4e-aa468625645e admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.521389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aeba0-3600-4872-ad4e-aa468625645e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:58.527196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aeba0-3600-4872-ad4e-aa468625645e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:58.553024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628faac-b08d-4cba-9b68-81720558795e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:58.553748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1120/2233] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:58.566533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628faac-b08d-4cba-9b68-81720558795e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:58.572755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7d8ec-99db-438f-afbe-936c19cc3769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:58.573797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7d8ec-99db-438f-afbe-936c19cc3769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.574211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7d8ec-99db-438f-afbe-936c19cc3769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.574630 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7d8ec-99db-438f-afbe-936c19cc3769 admin admin] PATH_INFO: `/v3/projects/5f5f75293cc041b7aa6a0a058f423517/users/7c20e7d85e584289aa236a012e25a12c/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.597455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7d8ec-99db-438f-afbe-936c19cc3769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5f75293cc041b7aa6a0a058f423517, user_id=7c20e7d85e584289aa236a012e25a12c, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:58.600420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7d8ec-99db-438f-afbe-936c19cc3769 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:58.615627 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1114/2234] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:58 2022] PUT /identity/v3/projects/5f5f75293cc041b7aa6a0a058f423517/users/7c20e7d85e584289aa236a012e25a12c/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:58.627617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b763b-c993-4dfd-90ac-b2a6fa2d6c49 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.627884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b763b-c993-4dfd-90ac-b2a6fa2d6c49 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.628153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b763b-c993-4dfd-90ac-b2a6fa2d6c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.656905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-346b763b-c993-4dfd-90ac-b2a6fa2d6c49 None None] MFA Rules not processed for user `7c20e7d85e584289aa236a012e25a12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:58.658276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-346b763b-c993-4dfd-90ac-b2a6fa2d6c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:58.667185 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:58.730367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1121/2235] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:58.735650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7d8ec-99db-438f-afbe-936c19cc3769 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:58.757593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:58.801085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7d8ec-99db-438f-afbe-936c19cc3769 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:58.806045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca95096-dcdc-40ee-a32c-d13431d70939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:58.806650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca95096-dcdc-40ee-a32c-d13431d70939 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.806927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca95096-dcdc-40ee-a32c-d13431d70939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.807201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca95096-dcdc-40ee-a32c-d13431d70939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.807895 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca95096-dcdc-40ee-a32c-d13431d70939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:58.809829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca95096-dcdc-40ee-a32c-d13431d70939 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:58.841467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1115/2236] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:13:58 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:13:58.843155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b763b-c993-4dfd-90ac-b2a6fa2d6c49 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:58.854156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b763b-c993-4dfd-90ac-b2a6fa2d6c49 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:58.916416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75425-aaf9-4c33-ade3-228c846c7a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:58.917099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75425-aaf9-4c33-ade3-228c846c7a41 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.917449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75425-aaf9-4c33-ade3-228c846c7a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.917809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75425-aaf9-4c33-ade3-228c846c7a41 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.918534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b75425-aaf9-4c33-ade3-228c846c7a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:58.921221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b75425-aaf9-4c33-ade3-228c846c7a41 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:58.951678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1122/2237] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:13:58 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:13:58.955874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca95096-dcdc-40ee-a32c-d13431d70939 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:58.966073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca95096-dcdc-40ee-a32c-d13431d70939 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:58.971105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c193633-cb87-4098-9d52-946fb484ec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:58.971703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c193633-cb87-4098-9d52-946fb484ec1f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:58.971982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c193633-cb87-4098-9d52-946fb484ec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:58.972257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c193633-cb87-4098-9d52-946fb484ec1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:58.974400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c193633-cb87-4098-9d52-946fb484ec1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:58.974610 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c193633-cb87-4098-9d52-946fb484ec1f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:58.988203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1116/2238] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:58.992450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75425-aaf9-4c33-ade3-228c846c7a41 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:59.005087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75425-aaf9-4c33-ade3-228c846c7a41 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:59.009968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6e21d-d05d-4d90-a7d8-ca87087e9cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:59.010731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6e21d-d05d-4d90-a7d8-ca87087e9cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:59.011110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6e21d-d05d-4d90-a7d8-ca87087e9cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:59.011457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6e21d-d05d-4d90-a7d8-ca87087e9cfa admin admin] PATH_INFO: `/v3/projects/28c4b6cd5b614699978924e13238dc50/users/40509cd5642644c6878c0cb5ca5610f3/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:59.027792 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6e21d-d05d-4d90-a7d8-ca87087e9cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c4b6cd5b614699978924e13238dc50, user_id=40509cd5642644c6878c0cb5ca5610f3, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:59.031377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6e21d-d05d-4d90-a7d8-ca87087e9cfa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:59.046803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1123/2239] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:58 2022] PUT /identity/v3/projects/28c4b6cd5b614699978924e13238dc50/users/40509cd5642644c6878c0cb5ca5610f3/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:59.050751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c193633-cb87-4098-9d52-946fb484ec1f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:59.063490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c193633-cb87-4098-9d52-946fb484ec1f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:59.141350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8552d-88c9-474a-ac25-ffa8a8479ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:59.142018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8552d-88c9-474a-ac25-ffa8a8479ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:59.142282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8552d-88c9-474a-ac25-ffa8a8479ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:59.142560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8552d-88c9-474a-ac25-ffa8a8479ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:59.143202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8552d-88c9-474a-ac25-ffa8a8479ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:59.144784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8552d-88c9-474a-ac25-ffa8a8479ba8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:59.159447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1117/2240] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:13:59.160640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6e21d-d05d-4d90-a7d8-ca87087e9cfa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:59.175413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6e21d-d05d-4d90-a7d8-ca87087e9cfa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:59.180201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704e59f-f84b-42f7-9e40-bce872903628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:59.180971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704e59f-f84b-42f7-9e40-bce872903628 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:59.181315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704e59f-f84b-42f7-9e40-bce872903628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:59.181702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704e59f-f84b-42f7-9e40-bce872903628 admin admin] PATH_INFO: `/v3/projects/28c4b6cd5b614699978924e13238dc50/users/40509cd5642644c6878c0cb5ca5610f3/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:59.183690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704e59f-f84b-42f7-9e40-bce872903628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c4b6cd5b614699978924e13238dc50, user_id=40509cd5642644c6878c0cb5ca5610f3, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:59.186812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704e59f-f84b-42f7-9e40-bce872903628 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:59.199974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1124/2241] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:13:59 2022] PUT /identity/v3/projects/28c4b6cd5b614699978924e13238dc50/users/40509cd5642644c6878c0cb5ca5610f3/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:13:59.210649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8a786-7725-460b-8c1c-4c38d9ed63fc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:59.211263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8a786-7725-460b-8c1c-4c38d9ed63fc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:59.211842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8a786-7725-460b-8c1c-4c38d9ed63fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:59.223881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939239f-16c2-4431-b512-44cbf886661c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:59.224118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939239f-16c2-4431-b512-44cbf886661c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:59.224387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939239f-16c2-4431-b512-44cbf886661c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:59.244891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-57d8a786-7725-460b-8c1c-4c38d9ed63fc None None] MFA Rules not processed for user `40509cd5642644c6878c0cb5ca5610f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:59.245152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d939239f-16c2-4431-b512-44cbf886661c None None] MFA Rules not processed for user `cf3436aaf4314c20af0c5816d7809e27`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:13:59.246328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-57d8a786-7725-460b-8c1c-4c38d9ed63fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:59.246452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d939239f-16c2-4431-b512-44cbf886661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:59.309972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1125/2242] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:13:59.319901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1118/2243] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:13:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:13:59.331185 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939239f-16c2-4431-b512-44cbf886661c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:13:59.332706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d939239f-16c2-4431-b512-44cbf886661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:13:59.339737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:59.394375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939239f-16c2-4431-b512-44cbf886661c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:13:59.398044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829efed0-b99e-4f0e-9438-a1e66e699f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:13:59.398645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829efed0-b99e-4f0e-9438-a1e66e699f10 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:13:59.398924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829efed0-b99e-4f0e-9438-a1e66e699f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:13:59.399194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829efed0-b99e-4f0e-9438-a1e66e699f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:13:59.457699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829efed0-b99e-4f0e-9438-a1e66e699f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:13:59.459053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829efed0-b99e-4f0e-9438-a1e66e699f10 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:13:59.468835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1126/2244] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:13:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:03.827970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8a786-7725-460b-8c1c-4c38d9ed63fc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:03.837366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8a786-7725-460b-8c1c-4c38d9ed63fc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:03.840799 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d83308-e1d7-4abe-8480-ac6b12c35b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:03.841388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d83308-e1d7-4abe-8480-ac6b12c35b5d service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:03.841697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d83308-e1d7-4abe-8480-ac6b12c35b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:03.841968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d83308-e1d7-4abe-8480-ac6b12c35b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:03.850627 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d83308-e1d7-4abe-8480-ac6b12c35b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:03.852004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d83308-e1d7-4abe-8480-ac6b12c35b5d service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:03.861931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1119/2245] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:06.966371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829efed0-b99e-4f0e-9438-a1e66e699f10 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:06.968718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-829efed0-b99e-4f0e-9438-a1e66e699f10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:07.053243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829efed0-b99e-4f0e-9438-a1e66e699f10 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:07.058407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:07.058978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:07.059257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:07.059527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] PATH_INFO: `/v3/users/ca325125770b416ea4a09d892eb7e713` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:07.060653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca325125770b416ea4a09d892eb7e713)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:07.063499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:07.110825 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca325125770b416ea4a09d892eb7e713'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:07.117870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca325125770b416ea4a09d892eb7e713'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:07.118488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca325125770b416ea4a09d892eb7e713'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:07.119136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca325125770b416ea4a09d892eb7e713'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:07.124974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:07.127055 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca325125770b416ea4a09d892eb7e713'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:07.146178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1127/2246] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:06 2022] DELETE /identity/v3/users/ca325125770b416ea4a09d892eb7e713 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:07.150843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951196b-284a-4da7-a998-eab879b40499 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:07.151301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951196b-284a-4da7-a998-eab879b40499 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:07.151393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951196b-284a-4da7-a998-eab879b40499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:07.158486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:07.171868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e951196b-284a-4da7-a998-eab879b40499 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:07.173084 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e951196b-284a-4da7-a998-eab879b40499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:07.233605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1120/2247] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:07.243311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:07.244758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:07.302765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b082-0a71-4681-bab1-4dcbef72724e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:07.307162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5947237-98b9-40a6-9f5b-fe5edadaeaea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:07.307808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947237-98b9-40a6-9f5b-fe5edadaeaea service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:07.308085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947237-98b9-40a6-9f5b-fe5edadaeaea service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:07.308509 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947237-98b9-40a6-9f5b-fe5edadaeaea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:07.319723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5947237-98b9-40a6-9f5b-fe5edadaeaea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:07.321406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5947237-98b9-40a6-9f5b-fe5edadaeaea service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:07.333407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1128/2248] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:07.616192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951196b-284a-4da7-a998-eab879b40499 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:07.619044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e951196b-284a-4da7-a998-eab879b40499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:07.634663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951196b-284a-4da7-a998-eab879b40499 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:07.643105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:07.644000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:07.644359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:07.644567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] PATH_INFO: `/v3/projects/1ff6cd192f9b46518ed244437922fe97` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:07.645798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff6cd192f9b46518ed244437922fe97)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:07.647741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:07.726874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff6cd192f9b46518ed244437922fe97', 'request_id': 'req-cff34889-3411-4a30-b90a-d9466f821be3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:07.735744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff6cd192f9b46518ed244437922fe97', 'request_id': 'req-cff34889-3411-4a30-b90a-d9466f821be3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:07.741710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff6cd192f9b46518ed244437922fe97', 'request_id': 'req-cff34889-3411-4a30-b90a-d9466f821be3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:07.753600 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] The token cache is being invalidate because project 1ff6cd192f9b46518ed244437922fe97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:07.754147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:07.754668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cff34889-3411-4a30-b90a-d9466f821be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:07.756393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1121/2249] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:07 2022] DELETE /identity/v3/projects/1ff6cd192f9b46518ed244437922fe97 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:07.761763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73d84-c874-456b-8912-9a249f97d68d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:07.762052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73d84-c874-456b-8912-9a249f97d68d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:07.762482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73d84-c874-456b-8912-9a249f97d68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:07.784531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fed73d84-c874-456b-8912-9a249f97d68d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:07.785880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fed73d84-c874-456b-8912-9a249f97d68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:07.845091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1129/2250] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:07.852873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf2ef-8e29-4ddb-86c5-3601fec5fc65 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:07.853190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf2ef-8e29-4ddb-86c5-3601fec5fc65 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:07.853466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf2ef-8e29-4ddb-86c5-3601fec5fc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:07.874492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d9bdf2ef-8e29-4ddb-86c5-3601fec5fc65 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:07.875693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d9bdf2ef-8e29-4ddb-86c5-3601fec5fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:07.883420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1122/2251] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:14:07.887653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73d84-c874-456b-8912-9a249f97d68d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:07.898078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73d84-c874-456b-8912-9a249f97d68d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:07.903013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7ac17-2ebf-40d1-b6c7-4d99434f6666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:07.903609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ac17-2ebf-40d1-b6c7-4d99434f6666 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:07.903885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ac17-2ebf-40d1-b6c7-4d99434f6666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:07.904182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ac17-2ebf-40d1-b6c7-4d99434f6666 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:07.904872 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7ac17-2ebf-40d1-b6c7-4d99434f6666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:14:07.905171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7ac17-2ebf-40d1-b6c7-4d99434f6666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:07.906850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7ac17-2ebf-40d1-b6c7-4d99434f6666 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:07.918580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1130/2252] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:14:07.922872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf2ef-8e29-4ddb-86c5-3601fec5fc65 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:07.932379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf2ef-8e29-4ddb-86c5-3601fec5fc65 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:07.937884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cb210-0e5d-4141-89b2-1e8b3f744128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:07.938489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cb210-0e5d-4141-89b2-1e8b3f744128 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:07.938769 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cb210-0e5d-4141-89b2-1e8b3f744128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:07.939084 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cb210-0e5d-4141-89b2-1e8b3f744128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:07.939728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cb210-0e5d-4141-89b2-1e8b3f744128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:07.941666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cb210-0e5d-4141-89b2-1e8b3f744128 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:07.972779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1123/2253] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:14:07 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:14:07.977370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7ac17-2ebf-40d1-b6c7-4d99434f6666 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:07.988383 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7ac17-2ebf-40d1-b6c7-4d99434f6666 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:08.050252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9886e1-185a-4741-a329-5b88eb7b9eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:08.050855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9886e1-185a-4741-a329-5b88eb7b9eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:08.051136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9886e1-185a-4741-a329-5b88eb7b9eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:08.051410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9886e1-185a-4741-a329-5b88eb7b9eaa admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:08.052043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9886e1-185a-4741-a329-5b88eb7b9eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:08.053988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9886e1-185a-4741-a329-5b88eb7b9eaa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:08.069979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:08.079484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1131/2254] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:14:07 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:08.083508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cb210-0e5d-4141-89b2-1e8b3f744128 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:08.093846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cb210-0e5d-4141-89b2-1e8b3f744128 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:08.098436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a7a1a-50b7-4160-9441-35ffa0013cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:08.098973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a7a1a-50b7-4160-9441-35ffa0013cec admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:08.099250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a7a1a-50b7-4160-9441-35ffa0013cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:08.099519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a7a1a-50b7-4160-9441-35ffa0013cec admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:08.100152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a7a1a-50b7-4160-9441-35ffa0013cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:08.101759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a7a1a-50b7-4160-9441-35ffa0013cec admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:08.111911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1124/2255] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:08.116084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9886e1-185a-4741-a329-5b88eb7b9eaa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:08.126478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9886e1-185a-4741-a329-5b88eb7b9eaa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:08.131088 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ae612-150b-40ca-a7ee-1abac2363daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:08.131676 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae612-150b-40ca-a7ee-1abac2363daf admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:08.131955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae612-150b-40ca-a7ee-1abac2363daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:08.132229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae612-150b-40ca-a7ee-1abac2363daf admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:08.132863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ae612-150b-40ca-a7ee-1abac2363daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:08.134538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ae612-150b-40ca-a7ee-1abac2363daf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:08.146024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1132/2256] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:08.149964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a7a1a-50b7-4160-9441-35ffa0013cec admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:08.159619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a7a1a-50b7-4160-9441-35ffa0013cec admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:08.164162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616b47a-5166-4492-b93a-e6dd14ee1719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:08.164800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616b47a-5166-4492-b93a-e6dd14ee1719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:08.165074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616b47a-5166-4492-b93a-e6dd14ee1719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:08.165342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616b47a-5166-4492-b93a-e6dd14ee1719 admin admin] PATH_INFO: `/v3/projects/16d46d83d86349ad835119e4f99753c3/users/0e2d1b7c58eb49f8adf40b0c4a4ec370/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:08.180595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616b47a-5166-4492-b93a-e6dd14ee1719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d46d83d86349ad835119e4f99753c3, user_id=0e2d1b7c58eb49f8adf40b0c4a4ec370, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:08.183354 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616b47a-5166-4492-b93a-e6dd14ee1719 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:08.196160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1125/2257] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:08 2022] PUT /identity/v3/projects/16d46d83d86349ad835119e4f99753c3/users/0e2d1b7c58eb49f8adf40b0c4a4ec370/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:08.206671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca38b9-99c7-4de5-a7c5-f5ae177e21b6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:08.206955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca38b9-99c7-4de5-a7c5-f5ae177e21b6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:08.207227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca38b9-99c7-4de5-a7c5-f5ae177e21b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:08.235231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cbca38b9-99c7-4de5-a7c5-f5ae177e21b6 None None] MFA Rules not processed for user `0e2d1b7c58eb49f8adf40b0c4a4ec370`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:08.236436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cbca38b9-99c7-4de5-a7c5-f5ae177e21b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:08.299354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1133/2258] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:08.800961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616b47a-5166-4492-b93a-e6dd14ee1719 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:08.802693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a616b47a-5166-4492-b93a-e6dd14ee1719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:08.828001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:08.867957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616b47a-5166-4492-b93a-e6dd14ee1719 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:08.872864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:08.873521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:08.873833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:08.874138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] PATH_INFO: `/v3/users/7c20e7d85e584289aa236a012e25a12c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:08.875573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c20e7d85e584289aa236a012e25a12c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:08.877541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:08.930967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c20e7d85e584289aa236a012e25a12c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:08.938583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c20e7d85e584289aa236a012e25a12c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:08.939301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c20e7d85e584289aa236a012e25a12c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:08.939908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c20e7d85e584289aa236a012e25a12c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:08.946899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c20e7d85e584289aa236a012e25a12c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:08.964017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1126/2259] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:08 2022] DELETE /identity/v3/users/7c20e7d85e584289aa236a012e25a12c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:08.968478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14955df-59e5-42eb-8f6b-cf5d149673ef None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:08.968890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14955df-59e5-42eb-8f6b-cf5d149673ef None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:08.969758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14955df-59e5-42eb-8f6b-cf5d149673ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:08.989288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c14955df-59e5-42eb-8f6b-cf5d149673ef None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:08.990550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c14955df-59e5-42eb-8f6b-cf5d149673ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:09.047854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1134/2260] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:09.057397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:09.058839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:09.117067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7deef9-90e2-42da-b680-239b9c6b852c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:09.120928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409e225-b04a-4e68-afe4-f4b60e067bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:09.121538 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409e225-b04a-4e68-afe4-f4b60e067bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:09.121847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409e225-b04a-4e68-afe4-f4b60e067bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:09.122120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409e225-b04a-4e68-afe4-f4b60e067bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:09.132067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409e225-b04a-4e68-afe4-f4b60e067bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:09.133490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409e225-b04a-4e68-afe4-f4b60e067bb3 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:09.143267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1127/2261] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:09.421179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14955df-59e5-42eb-8f6b-cf5d149673ef None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:09.422640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c14955df-59e5-42eb-8f6b-cf5d149673ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:09.438155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14955df-59e5-42eb-8f6b-cf5d149673ef None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:09.443049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:09.443692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:09.443972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:09.444249 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] PATH_INFO: `/v3/projects/5f5f75293cc041b7aa6a0a058f423517` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:09.445390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5f75293cc041b7aa6a0a058f423517)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:09.447331 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:09.497488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5f75293cc041b7aa6a0a058f423517', 'request_id': 'req-76d4f937-870a-4cf8-b75e-9e3585e6ba01'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:09.503327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5f75293cc041b7aa6a0a058f423517', 'request_id': 'req-76d4f937-870a-4cf8-b75e-9e3585e6ba01'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:09.511924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5f75293cc041b7aa6a0a058f423517', 'request_id': 'req-76d4f937-870a-4cf8-b75e-9e3585e6ba01'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:09.521375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:09.528578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] The token cache is being invalidate because project 5f5f75293cc041b7aa6a0a058f423517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:09.528971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:09.529584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:09.533301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1135/2262] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:09 2022] DELETE /identity/v3/projects/5f5f75293cc041b7aa6a0a058f423517 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:09.537800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409e225-b04a-4e68-afe4-f4b60e067bb3 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:09.549021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409e225-b04a-4e68-afe4-f4b60e067bb3 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:09.589292 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:09.607922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:09.608556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:09.608836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:09.609105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] PATH_INFO: `/v3/users/40509cd5642644c6878c0cb5ca5610f3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:09.610866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40509cd5642644c6878c0cb5ca5610f3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:09.612761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:09.663842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40509cd5642644c6878c0cb5ca5610f3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:09.673393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40509cd5642644c6878c0cb5ca5610f3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:09.674632 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40509cd5642644c6878c0cb5ca5610f3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:09.675227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40509cd5642644c6878c0cb5ca5610f3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:09.683118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40509cd5642644c6878c0cb5ca5610f3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:09.702266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1128/2263] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:09 2022] DELETE /identity/v3/users/40509cd5642644c6878c0cb5ca5610f3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:09.988313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:09.989763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:10.005742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4f937-870a-4cf8-b75e-9e3585e6ba01 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:10.007603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:10.009161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:10.067232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:10.067863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.068144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.068420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] PATH_INFO: `/v3/projects/28c4b6cd5b614699978924e13238dc50` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.069543 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c4b6cd5b614699978924e13238dc50)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:10.070684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c2f1-51f0-424e-8ba9-3cf864753529 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:10.071476 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:10.074246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3fe91-b7f4-44ea-9a1f-99d3b824a548 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f20fbf033f04036b48194a804dae8c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:10.074878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3fe91-b7f4-44ea-9a1f-99d3b824a548 service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.075155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3fe91-b7f4-44ea-9a1f-99d3b824a548 service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.075420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3fe91-b7f4-44ea-9a1f-99d3b824a548 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.077158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d6c3fe91-b7f4-44ea-9a1f-99d3b824a548 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:10.120629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c4b6cd5b614699978924e13238dc50', 'request_id': 'req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:10.126672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c4b6cd5b614699978924e13238dc50', 'request_id': 'req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:10.135577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c4b6cd5b614699978924e13238dc50', 'request_id': 'req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:10.149978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] The token cache is being invalidate because project 28c4b6cd5b614699978924e13238dc50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:10.150234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:10.150882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2cda3fc7-5eb5-4b12-be80-c7c3d8815d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:10.152111 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3fe91-b7f4-44ea-9a1f-99d3b824a548 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:10.154483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1136/2264] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:09 2022] DELETE /identity/v3/projects/28c4b6cd5b614699978924e13238dc50 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:10.154611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3fe91-b7f4-44ea-9a1f-99d3b824a548 service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:10.160060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584c30-3e07-4263-b059-65469790c8be None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.161662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584c30-3e07-4263-b059-65469790c8be None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.161662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584c30-3e07-4263-b059-65469790c8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.168559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1129/2265] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:14:10.181225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-59584c30-3e07-4263-b059-65469790c8be None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:10.182445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-59584c30-3e07-4263-b059-65469790c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:10.263149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1137/2266] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:14:10.271728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212b910-3b71-4cb5-9434-bfc01488cae7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.272023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212b910-3b71-4cb5-9434-bfc01488cae7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.272352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212b910-3b71-4cb5-9434-bfc01488cae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.292789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6212b910-3b71-4cb5-9434-bfc01488cae7 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:10.294021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6212b910-3b71-4cb5-9434-bfc01488cae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:10.302303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1130/2267] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:10.306595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59584c30-3e07-4263-b059-65469790c8be None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:10.324870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59584c30-3e07-4263-b059-65469790c8be None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:10.339427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e560cd-1ae6-4394-be82-3a7434e560d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:10.340056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e560cd-1ae6-4394-be82-3a7434e560d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.340336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e560cd-1ae6-4394-be82-3a7434e560d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.340610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e560cd-1ae6-4394-be82-3a7434e560d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.342868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e560cd-1ae6-4394-be82-3a7434e560d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:14:10.343184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e560cd-1ae6-4394-be82-3a7434e560d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:10.344857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e560cd-1ae6-4394-be82-3a7434e560d5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:10.366988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1138/2268] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:14:10.374067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212b910-3b71-4cb5-9434-bfc01488cae7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:10.396635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212b910-3b71-4cb5-9434-bfc01488cae7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:10.403389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd36d4-4bbd-4094-a3e1-a95f460fd608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:10.404020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd36d4-4bbd-4094-a3e1-a95f460fd608 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.404305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd36d4-4bbd-4094-a3e1-a95f460fd608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.404584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd36d4-4bbd-4094-a3e1-a95f460fd608 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.405899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd36d4-4bbd-4094-a3e1-a95f460fd608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:10.408526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd36d4-4bbd-4094-a3e1-a95f460fd608 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:10.419743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:10.448738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1131/2269] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:14:10 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:10.453963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e560cd-1ae6-4394-be82-3a7434e560d5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:10.466007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e560cd-1ae6-4394-be82-3a7434e560d5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:10.488456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:10.540617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d341b-97e5-4ce2-bd02-c4ca1a1f3fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:10.541233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d341b-97e5-4ce2-bd02-c4ca1a1f3fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.541515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d341b-97e5-4ce2-bd02-c4ca1a1f3fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.541909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d341b-97e5-4ce2-bd02-c4ca1a1f3fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.542604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d341b-97e5-4ce2-bd02-c4ca1a1f3fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:10.544532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d341b-97e5-4ce2-bd02-c4ca1a1f3fa5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:10.568035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1139/2270] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:14:10 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:10.572045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd36d4-4bbd-4094-a3e1-a95f460fd608 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:10.583714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd36d4-4bbd-4094-a3e1-a95f460fd608 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:10.588963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9192a8-84ec-4551-87bb-b4e71e3e78f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:10.589637 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9192a8-84ec-4551-87bb-b4e71e3e78f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.589947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9192a8-84ec-4551-87bb-b4e71e3e78f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.590240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9192a8-84ec-4551-87bb-b4e71e3e78f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.590975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9192a8-84ec-4551-87bb-b4e71e3e78f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:10.592658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9192a8-84ec-4551-87bb-b4e71e3e78f6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:10.607054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1132/2271] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:10.612787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d341b-97e5-4ce2-bd02-c4ca1a1f3fa5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:10.632962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d341b-97e5-4ce2-bd02-c4ca1a1f3fa5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:10.641963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae67140-be30-487e-bdf5-ae4fee337afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:10.642978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67140-be30-487e-bdf5-ae4fee337afe admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.644363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67140-be30-487e-bdf5-ae4fee337afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.644771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67140-be30-487e-bdf5-ae4fee337afe admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.645655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae67140-be30-487e-bdf5-ae4fee337afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:10.649501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae67140-be30-487e-bdf5-ae4fee337afe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:10.674698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1140/2272] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:10.678531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9192a8-84ec-4551-87bb-b4e71e3e78f6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:10.690509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9192a8-84ec-4551-87bb-b4e71e3e78f6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:10.695345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf18b7-7cdc-43d3-80fb-314743cec682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:10.696091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf18b7-7cdc-43d3-80fb-314743cec682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.696306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf18b7-7cdc-43d3-80fb-314743cec682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.696576 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf18b7-7cdc-43d3-80fb-314743cec682 admin admin] PATH_INFO: `/v3/projects/1794459a3afd4c9ca3a5856eaec56b28/users/eddf93428cbc4c80868156a36af91dc9/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.713579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf18b7-7cdc-43d3-80fb-314743cec682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1794459a3afd4c9ca3a5856eaec56b28, user_id=eddf93428cbc4c80868156a36af91dc9, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:10.716873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf18b7-7cdc-43d3-80fb-314743cec682 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:10.738419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1133/2273] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:10 2022] PUT /identity/v3/projects/1794459a3afd4c9ca3a5856eaec56b28/users/eddf93428cbc4c80868156a36af91dc9/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:10.767084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd8ab-8afb-4ad7-938c-f92f2f232720 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.767446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd8ab-8afb-4ad7-938c-f92f2f232720 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.767790 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd8ab-8afb-4ad7-938c-f92f2f232720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.803572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-072bd8ab-8afb-4ad7-938c-f92f2f232720 None None] MFA Rules not processed for user `eddf93428cbc4c80868156a36af91dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:10.804785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-072bd8ab-8afb-4ad7-938c-f92f2f232720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:10.893393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1141/2274] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:10.898104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf18b7-7cdc-43d3-80fb-314743cec682 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:10.974920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf18b7-7cdc-43d3-80fb-314743cec682 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:10.980057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844991a-747b-456a-bc61-25190e779743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:10.981069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844991a-747b-456a-bc61-25190e779743 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:10.981428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844991a-747b-456a-bc61-25190e779743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:10.981805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844991a-747b-456a-bc61-25190e779743 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:10.982594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844991a-747b-456a-bc61-25190e779743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:10.985413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844991a-747b-456a-bc61-25190e779743 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.028559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1134/2275] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:14:10 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:14:11.030412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd8ab-8afb-4ad7-938c-f92f2f232720 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.042461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd8ab-8afb-4ad7-938c-f92f2f232720 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:11.104580 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1b3b4-7ce7-4734-b8af-c3da89fb29fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:11.105275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1b3b4-7ce7-4734-b8af-c3da89fb29fe admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.105891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1b3b4-7ce7-4734-b8af-c3da89fb29fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.106229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1b3b4-7ce7-4734-b8af-c3da89fb29fe admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.106922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1b3b4-7ce7-4734-b8af-c3da89fb29fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:11.108884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1b3b4-7ce7-4734-b8af-c3da89fb29fe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.135300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1142/2276] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:14:11 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:11.136881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844991a-747b-456a-bc61-25190e779743 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.148624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844991a-747b-456a-bc61-25190e779743 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:11.153709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9021c8-169e-4f10-98c4-da6cf26119bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:11.154325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9021c8-169e-4f10-98c4-da6cf26119bd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.154594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9021c8-169e-4f10-98c4-da6cf26119bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.154872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9021c8-169e-4f10-98c4-da6cf26119bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.155508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9021c8-169e-4f10-98c4-da6cf26119bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:11.158155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9021c8-169e-4f10-98c4-da6cf26119bd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.168810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1135/2277] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:11.175004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1b3b4-7ce7-4734-b8af-c3da89fb29fe admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.185337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1b3b4-7ce7-4734-b8af-c3da89fb29fe admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:11.190281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908a02f-56ca-4804-94e5-8a1dbad9dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:11.190870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a02f-56ca-4804-94e5-8a1dbad9dc17 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.191145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a02f-56ca-4804-94e5-8a1dbad9dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.191412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a02f-56ca-4804-94e5-8a1dbad9dc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.192139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908a02f-56ca-4804-94e5-8a1dbad9dc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:11.193659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908a02f-56ca-4804-94e5-8a1dbad9dc17 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.204935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1143/2278] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:11.209960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9021c8-169e-4f10-98c4-da6cf26119bd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.221968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9021c8-169e-4f10-98c4-da6cf26119bd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:11.228637 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a6e34-5e10-437b-8f86-e695cd7097bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:11.229444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6e34-5e10-437b-8f86-e695cd7097bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.229841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6e34-5e10-437b-8f86-e695cd7097bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.230115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6e34-5e10-437b-8f86-e695cd7097bc admin admin] PATH_INFO: `/v3/projects/026c31abd05240c88d64b9f1fd829cd7/users/26ff949dc62c4b8da843d974977e8edf/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.245343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a6e34-5e10-437b-8f86-e695cd7097bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=026c31abd05240c88d64b9f1fd829cd7, user_id=26ff949dc62c4b8da843d974977e8edf, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:11.248037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a6e34-5e10-437b-8f86-e695cd7097bc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.262217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1136/2279] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:11 2022] PUT /identity/v3/projects/026c31abd05240c88d64b9f1fd829cd7/users/26ff949dc62c4b8da843d974977e8edf/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:11.273672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d22c8-2dc8-4d20-bf58-60304862f3df None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.273968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d22c8-2dc8-4d20-bf58-60304862f3df None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.274243 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d22c8-2dc8-4d20-bf58-60304862f3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.283097 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:11.305789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-228d22c8-2dc8-4d20-bf58-60304862f3df None None] MFA Rules not processed for user `26ff949dc62c4b8da843d974977e8edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:11.307464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-228d22c8-2dc8-4d20-bf58-60304862f3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:11.375194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1144/2280] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:11.379984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a6e34-5e10-437b-8f86-e695cd7097bc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.444672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a6e34-5e10-437b-8f86-e695cd7097bc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:11.449542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5b71d-1f44-4f2f-92e7-e75fde165e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:11.450285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5b71d-1f44-4f2f-92e7-e75fde165e4a admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.450555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5b71d-1f44-4f2f-92e7-e75fde165e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.450896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5b71d-1f44-4f2f-92e7-e75fde165e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.451910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5b71d-1f44-4f2f-92e7-e75fde165e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:11.454774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5b71d-1f44-4f2f-92e7-e75fde165e4a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.465889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:11.489677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1137/2281] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:14:11 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:11.491009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d22c8-2dc8-4d20-bf58-60304862f3df None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.502104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d22c8-2dc8-4d20-bf58-60304862f3df None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:11.557030 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1004912-2adb-4cf9-9986-4e0b25bf7d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:11.557655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1004912-2adb-4cf9-9986-4e0b25bf7d47 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.557938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1004912-2adb-4cf9-9986-4e0b25bf7d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.558211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1004912-2adb-4cf9-9986-4e0b25bf7d47 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.558854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1004912-2adb-4cf9-9986-4e0b25bf7d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:11.560758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1004912-2adb-4cf9-9986-4e0b25bf7d47 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.586275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1145/2282] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:14:11 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:14:11.587554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5b71d-1f44-4f2f-92e7-e75fde165e4a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.600104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5b71d-1f44-4f2f-92e7-e75fde165e4a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:11.604837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595184d-c367-407e-af26-ad8d621fca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:11.605439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595184d-c367-407e-af26-ad8d621fca2e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.606050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595184d-c367-407e-af26-ad8d621fca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.606325 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595184d-c367-407e-af26-ad8d621fca2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.606959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595184d-c367-407e-af26-ad8d621fca2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:11.608531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595184d-c367-407e-af26-ad8d621fca2e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.620216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1138/2283] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:11.624550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1004912-2adb-4cf9-9986-4e0b25bf7d47 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.634936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1004912-2adb-4cf9-9986-4e0b25bf7d47 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:11.639818 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093f262-0d20-4591-82e2-f9a7778434f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:11.640759 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093f262-0d20-4591-82e2-f9a7778434f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.641157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093f262-0d20-4591-82e2-f9a7778434f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.641458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093f262-0d20-4591-82e2-f9a7778434f6 admin admin] PATH_INFO: `/v3/projects/7ab999d184994fc5bf3cc3b16b27d4a9/users/679deb011d4549af82c17182ee60044f/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.658693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093f262-0d20-4591-82e2-f9a7778434f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab999d184994fc5bf3cc3b16b27d4a9, user_id=679deb011d4549af82c17182ee60044f, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:11.663455 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093f262-0d20-4591-82e2-f9a7778434f6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.679328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1146/2284] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:11 2022] PUT /identity/v3/projects/7ab999d184994fc5bf3cc3b16b27d4a9/users/679deb011d4549af82c17182ee60044f/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:11.684074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595184d-c367-407e-af26-ad8d621fca2e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.695813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595184d-c367-407e-af26-ad8d621fca2e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:11.757527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb62eb3-b000-491d-8639-f1c78a368edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:11.758171 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62eb3-b000-491d-8639-f1c78a368edf admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.758451 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62eb3-b000-491d-8639-f1c78a368edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.762825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62eb3-b000-491d-8639-f1c78a368edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.763652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb62eb3-b000-491d-8639-f1c78a368edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:11.765249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb62eb3-b000-491d-8639-f1c78a368edf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.777007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1139/2285] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:11.781125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093f262-0d20-4591-82e2-f9a7778434f6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.793077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093f262-0d20-4591-82e2-f9a7778434f6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:11.803735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd3676-3b1a-490a-8b86-73356e14e03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:11.804662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd3676-3b1a-490a-8b86-73356e14e03a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.805239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd3676-3b1a-490a-8b86-73356e14e03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.805603 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd3676-3b1a-490a-8b86-73356e14e03a admin admin] PATH_INFO: `/v3/projects/7ab999d184994fc5bf3cc3b16b27d4a9/users/679deb011d4549af82c17182ee60044f/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.808176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd3676-3b1a-490a-8b86-73356e14e03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab999d184994fc5bf3cc3b16b27d4a9, user_id=679deb011d4549af82c17182ee60044f, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:11.811134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd3676-3b1a-490a-8b86-73356e14e03a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:11.824470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1147/2286] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:11 2022] PUT /identity/v3/projects/7ab999d184994fc5bf3cc3b16b27d4a9/users/679deb011d4549af82c17182ee60044f/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:11.834939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4a20-19d0-4af9-89a2-05d2edb624fb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:11.835231 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4a20-19d0-4af9-89a2-05d2edb624fb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:11.835506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4a20-19d0-4af9-89a2-05d2edb624fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:11.868943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0e1a4a20-19d0-4af9-89a2-05d2edb624fb None None] MFA Rules not processed for user `679deb011d4549af82c17182ee60044f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:11.870235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0e1a4a20-19d0-4af9-89a2-05d2edb624fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:11.942107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1140/2287] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:11.953421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd3676-3b1a-490a-8b86-73356e14e03a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:11.955254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0ddd3676-3b1a-490a-8b86-73356e14e03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:12.011460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:12.018401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd3676-3b1a-490a-8b86-73356e14e03a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:12.026682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619e10-34a8-4f9b-baba-97f5ec9e338b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:12.027832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619e10-34a8-4f9b-baba-97f5ec9e338b service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:12.028197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619e10-34a8-4f9b-baba-97f5ec9e338b service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:12.028532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619e10-34a8-4f9b-baba-97f5ec9e338b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:12.092964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09619e10-34a8-4f9b-baba-97f5ec9e338b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:12.094503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09619e10-34a8-4f9b-baba-97f5ec9e338b service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:12.103928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1148/2288] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:13.664714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4a20-19d0-4af9-89a2-05d2edb624fb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:13.666478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0e1a4a20-19d0-4af9-89a2-05d2edb624fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:13.679181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4a20-19d0-4af9-89a2-05d2edb624fb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:13.683421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea54954-4a87-4c39-b37a-aa69668abb53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:13.684038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea54954-4a87-4c39-b37a-aa69668abb53 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:13.684321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea54954-4a87-4c39-b37a-aa69668abb53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:13.684591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea54954-4a87-4c39-b37a-aa69668abb53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:13.743680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea54954-4a87-4c39-b37a-aa69668abb53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:13.745186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea54954-4a87-4c39-b37a-aa69668abb53 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:13.748751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:13.756380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1141/2289] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:14.553057 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619e10-34a8-4f9b-baba-97f5ec9e338b service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:14.561783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619e10-34a8-4f9b-baba-97f5ec9e338b service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:14.567036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b8f25-e071-4ad8-8f80-75a32d1dfbcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:14.567717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b8f25-e071-4ad8-8f80-75a32d1dfbcd service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:14.568070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b8f25-e071-4ad8-8f80-75a32d1dfbcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:14.568407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b8f25-e071-4ad8-8f80-75a32d1dfbcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:14.578696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b8f25-e071-4ad8-8f80-75a32d1dfbcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:14.580223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b8f25-e071-4ad8-8f80-75a32d1dfbcd service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:14.590598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1149/2290] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:18.558439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea54954-4a87-4c39-b37a-aa69668abb53 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:18.636017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea54954-4a87-4c39-b37a-aa69668abb53 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:18.640984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:18.641863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:18.642145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:18.642442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] PATH_INFO: `/v3/users/eddf93428cbc4c80868156a36af91dc9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:18.644807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eddf93428cbc4c80868156a36af91dc9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:18.647321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:18.700933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eddf93428cbc4c80868156a36af91dc9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:18.709979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eddf93428cbc4c80868156a36af91dc9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:18.710647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eddf93428cbc4c80868156a36af91dc9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:18.711509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eddf93428cbc4c80868156a36af91dc9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:18.719796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eddf93428cbc4c80868156a36af91dc9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:18.739812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1142/2291] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:18 2022] DELETE /identity/v3/users/eddf93428cbc4c80868156a36af91dc9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:18.744797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b6a44-1a6a-498c-90fa-3eb8740769cc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:18.745493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b6a44-1a6a-498c-90fa-3eb8740769cc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:18.745877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b6a44-1a6a-498c-90fa-3eb8740769cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:18.769847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-729b6a44-1a6a-498c-90fa-3eb8740769cc None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:18.771039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-729b6a44-1a6a-498c-90fa-3eb8740769cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:18.834113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1150/2292] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:18.843772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:18.845173 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:18.901881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab8d1a-4586-4d6e-8298-189acd6809b9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:18.905483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4b1c2-f6df-4ec2-b94e-4922e09713f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:18.906122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4b1c2-f6df-4ec2-b94e-4922e09713f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:18.906389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4b1c2-f6df-4ec2-b94e-4922e09713f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:18.906661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4b1c2-f6df-4ec2-b94e-4922e09713f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:18.915683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4b1c2-f6df-4ec2-b94e-4922e09713f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:18.917139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4b1c2-f6df-4ec2-b94e-4922e09713f4 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:18.927743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1143/2293] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:19.189011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b6a44-1a6a-498c-90fa-3eb8740769cc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:19.191205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-729b6a44-1a6a-498c-90fa-3eb8740769cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:19.205471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b6a44-1a6a-498c-90fa-3eb8740769cc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:19.211161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:19.211882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:19.212232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:19.212576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] PATH_INFO: `/v3/projects/1794459a3afd4c9ca3a5856eaec56b28` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:19.213898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1794459a3afd4c9ca3a5856eaec56b28)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:19.217052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:19.268001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1794459a3afd4c9ca3a5856eaec56b28', 'request_id': 'req-55abb54b-d66a-45bb-82f9-a1520f91ac98'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.277077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1794459a3afd4c9ca3a5856eaec56b28', 'request_id': 'req-55abb54b-d66a-45bb-82f9-a1520f91ac98'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.289183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1794459a3afd4c9ca3a5856eaec56b28', 'request_id': 'req-55abb54b-d66a-45bb-82f9-a1520f91ac98'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.311112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] The token cache is being invalidate because project 1794459a3afd4c9ca3a5856eaec56b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:19.311460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.312225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.316087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1151/2294] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:19 2022] DELETE /identity/v3/projects/1794459a3afd4c9ca3a5856eaec56b28 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:19.318626 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4b1c2-f6df-4ec2-b94e-4922e09713f4 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:19.330837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4b1c2-f6df-4ec2-b94e-4922e09713f4 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:19.351268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:19.403145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:19.403696 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:19.404057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:19.404237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] PATH_INFO: `/v3/users/26ff949dc62c4b8da843d974977e8edf` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:19.405362 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ff949dc62c4b8da843d974977e8edf)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:19.407299 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:19.456646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ff949dc62c4b8da843d974977e8edf'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.463927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ff949dc62c4b8da843d974977e8edf'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.464524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ff949dc62c4b8da843d974977e8edf'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.465108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ff949dc62c4b8da843d974977e8edf'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.472728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ff949dc62c4b8da843d974977e8edf'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.491343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1144/2295] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:19 2022] DELETE /identity/v3/users/26ff949dc62c4b8da843d974977e8edf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:14:19.771186 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:19.772764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:19.789611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb54b-d66a-45bb-82f9-a1520f91ac98 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:19.798927 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:19.854533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:19.855163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:19.855440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:19.855997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] PATH_INFO: `/v3/projects/026c31abd05240c88d64b9f1fd829cd7` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:19.857204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=026c31abd05240c88d64b9f1fd829cd7)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:19.859306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:19.906732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026c31abd05240c88d64b9f1fd829cd7', 'request_id': 'req-06853120-b37d-4350-92c0-6cca04928dbc'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.912824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026c31abd05240c88d64b9f1fd829cd7', 'request_id': 'req-06853120-b37d-4350-92c0-6cca04928dbc'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.920664 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026c31abd05240c88d64b9f1fd829cd7', 'request_id': 'req-06853120-b37d-4350-92c0-6cca04928dbc'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.932314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] The token cache is being invalidate because project 026c31abd05240c88d64b9f1fd829cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:19.932606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.933256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:19.934750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1152/2296] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:19 2022] DELETE /identity/v3/projects/026c31abd05240c88d64b9f1fd829cd7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:19.938776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:19.940485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:19.952894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824a72a-f925-405c-b5e9-410849f04e95 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:20.011257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:20.011976 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.012332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.012651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] PATH_INFO: `/v3/users/679deb011d4549af82c17182ee60044f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:20.013857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=679deb011d4549af82c17182ee60044f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:20.015815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:20.058972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:20.064485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679deb011d4549af82c17182ee60044f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:20.072814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679deb011d4549af82c17182ee60044f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:20.073471 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679deb011d4549af82c17182ee60044f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:20.074137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679deb011d4549af82c17182ee60044f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:20.081803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49c7f0c5-f6a2-43a1-b082-108eaa62ca22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679deb011d4549af82c17182ee60044f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:20.099340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1145/2297] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:19 2022] DELETE /identity/v3/users/679deb011d4549af82c17182ee60044f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:20.373369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:20.375126 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:20.408628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06853120-b37d-4350-92c0-6cca04928dbc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:20.470775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:20.472056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.472312 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.472584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] PATH_INFO: `/v3/projects/7ab999d184994fc5bf3cc3b16b27d4a9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:20.473733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab999d184994fc5bf3cc3b16b27d4a9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:20.475628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:20.519974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:20.524434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab999d184994fc5bf3cc3b16b27d4a9', 'request_id': 'req-1d909f56-38de-4688-a0c6-6ea1ca880dbe'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:20.531209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab999d184994fc5bf3cc3b16b27d4a9', 'request_id': 'req-1d909f56-38de-4688-a0c6-6ea1ca880dbe'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:20.540182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab999d184994fc5bf3cc3b16b27d4a9', 'request_id': 'req-1d909f56-38de-4688-a0c6-6ea1ca880dbe'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:20.552947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] The token cache is being invalidate because project 7ab999d184994fc5bf3cc3b16b27d4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:20.553234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:20.553901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d909f56-38de-4688-a0c6-6ea1ca880dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:20.555474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1153/2298] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:20 2022] DELETE /identity/v3/projects/7ab999d184994fc5bf3cc3b16b27d4a9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:20.560643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89a42-7aa0-420f-acf2-0d226b17d5d3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.560842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89a42-7aa0-420f-acf2-0d226b17d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.561122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89a42-7aa0-420f-acf2-0d226b17d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:20.580939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-41f89a42-7aa0-420f-acf2-0d226b17d5d3 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:20.582179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-41f89a42-7aa0-420f-acf2-0d226b17d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:20.642494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1146/2299] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:20.651326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622d19f-0a75-47d7-8a29-2143321f8188 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.651612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622d19f-0a75-47d7-8a29-2143321f8188 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.651997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622d19f-0a75-47d7-8a29-2143321f8188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:20.672590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8622d19f-0a75-47d7-8a29-2143321f8188 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:20.674029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8622d19f-0a75-47d7-8a29-2143321f8188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:20.682750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1154/2300] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:20.687037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f89a42-7aa0-420f-acf2-0d226b17d5d3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:20.697347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f89a42-7aa0-420f-acf2-0d226b17d5d3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:20.701920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd811e42-f496-4b05-b037-da8e955abff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:20.702527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811e42-f496-4b05-b037-da8e955abff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.702811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811e42-f496-4b05-b037-da8e955abff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.703114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811e42-f496-4b05-b037-da8e955abff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:20.703881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd811e42-f496-4b05-b037-da8e955abff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:14:20.704193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd811e42-f496-4b05-b037-da8e955abff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:20.706558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd811e42-f496-4b05-b037-da8e955abff1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:20.718993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1147/2301] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:14:20.723913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622d19f-0a75-47d7-8a29-2143321f8188 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:20.733241 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622d19f-0a75-47d7-8a29-2143321f8188 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:20.738492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98611820-0b0c-45a2-adff-72719c65db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:20.739075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98611820-0b0c-45a2-adff-72719c65db4c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.739377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98611820-0b0c-45a2-adff-72719c65db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.739649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98611820-0b0c-45a2-adff-72719c65db4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:20.740271 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98611820-0b0c-45a2-adff-72719c65db4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:20.742194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98611820-0b0c-45a2-adff-72719c65db4c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:20.768179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1155/2302] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:14:20 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:20.772243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd811e42-f496-4b05-b037-da8e955abff1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:20.782257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd811e42-f496-4b05-b037-da8e955abff1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:20.839284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7363-0f08-41c9-9c08-12ca43dcfcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:20.839890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7363-0f08-41c9-9c08-12ca43dcfcda admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.840168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7363-0f08-41c9-9c08-12ca43dcfcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.840445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7363-0f08-41c9-9c08-12ca43dcfcda admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:20.841076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb7363-0f08-41c9-9c08-12ca43dcfcda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:20.843030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb7363-0f08-41c9-9c08-12ca43dcfcda admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:20.866333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1148/2303] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:14:20 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:14:20.870343 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98611820-0b0c-45a2-adff-72719c65db4c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:20.881677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98611820-0b0c-45a2-adff-72719c65db4c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:20.886204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd15800-31a8-417b-b9a9-1444ffa7a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:20.886793 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd15800-31a8-417b-b9a9-1444ffa7a2ab admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.887069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd15800-31a8-417b-b9a9-1444ffa7a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.887336 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd15800-31a8-417b-b9a9-1444ffa7a2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:20.888107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd15800-31a8-417b-b9a9-1444ffa7a2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:20.889721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd15800-31a8-417b-b9a9-1444ffa7a2ab admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:20.902771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1156/2304] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:14:20.904044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7363-0f08-41c9-9c08-12ca43dcfcda admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:20.914120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7363-0f08-41c9-9c08-12ca43dcfcda admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:20.918980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b39e1-b612-47d2-9fdb-0c567d16dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:20.919573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b39e1-b612-47d2-9fdb-0c567d16dd05 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.919874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b39e1-b612-47d2-9fdb-0c567d16dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.920133 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b39e1-b612-47d2-9fdb-0c567d16dd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:20.920768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b39e1-b612-47d2-9fdb-0c567d16dd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:20.922409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b39e1-b612-47d2-9fdb-0c567d16dd05 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:20.934377 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1149/2305] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:20.938226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd15800-31a8-417b-b9a9-1444ffa7a2ab admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:20.948501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd15800-31a8-417b-b9a9-1444ffa7a2ab admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:20.953091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf1ad8-ed5b-4e87-8df1-d874efda1833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:20.953770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf1ad8-ed5b-4e87-8df1-d874efda1833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.954051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf1ad8-ed5b-4e87-8df1-d874efda1833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.954329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf1ad8-ed5b-4e87-8df1-d874efda1833 admin admin] PATH_INFO: `/v3/projects/bd60470c140247afb90345ab6f6715a4/users/f350a091096742519e5a925ecf3b8ee0/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:20.970950 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf1ad8-ed5b-4e87-8df1-d874efda1833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd60470c140247afb90345ab6f6715a4, user_id=f350a091096742519e5a925ecf3b8ee0, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:20.974471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf1ad8-ed5b-4e87-8df1-d874efda1833 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:20.994673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1157/2306] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:20 2022] PUT /identity/v3/projects/bd60470c140247afb90345ab6f6715a4/users/f350a091096742519e5a925ecf3b8ee0/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:20.996098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117987f5-a97d-49cd-a2d8-b809d4c7b80d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:20.996560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117987f5-a97d-49cd-a2d8-b809d4c7b80d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:20.996665 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117987f5-a97d-49cd-a2d8-b809d4c7b80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:21.016547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-117987f5-a97d-49cd-a2d8-b809d4c7b80d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:21.017879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-117987f5-a97d-49cd-a2d8-b809d4c7b80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:21.036166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:21.079689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1150/2307] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:14:21.089358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf1ad8-ed5b-4e87-8df1-d874efda1833 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:21.091082 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f3bf1ad8-ed5b-4e87-8df1-d874efda1833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:21.147005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf1ad8-ed5b-4e87-8df1-d874efda1833 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:21.150766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb9447-1624-4cbd-9f48-f2db53deb6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:21.151403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9447-1624-4cbd-9f48-f2db53deb6dd service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:21.151685 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9447-1624-4cbd-9f48-f2db53deb6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:21.151956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9447-1624-4cbd-9f48-f2db53deb6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:21.161816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb9447-1624-4cbd-9f48-f2db53deb6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:21.163244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb9447-1624-4cbd-9f48-f2db53deb6dd service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:21.172640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1158/2308] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:14:24.400396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117987f5-a97d-49cd-a2d8-b809d4c7b80d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:24.402096 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-117987f5-a97d-49cd-a2d8-b809d4c7b80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:24.428019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117987f5-a97d-49cd-a2d8-b809d4c7b80d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:24.439108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:24.440342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:24.440898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:24.441405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] PATH_INFO: `/v3/users/1d0cc5c8ab4445c2b2c6e97659502023` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:24.442652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0cc5c8ab4445c2b2c6e97659502023)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:24.444667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:24.510233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0cc5c8ab4445c2b2c6e97659502023'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:24.526213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0cc5c8ab4445c2b2c6e97659502023'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:24.527105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0cc5c8ab4445c2b2c6e97659502023'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:24.527749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0cc5c8ab4445c2b2c6e97659502023'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:24.538438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0cc5c8ab4445c2b2c6e97659502023'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:24.565792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1151/2309] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:24 2022] DELETE /identity/v3/users/1d0cc5c8ab4445c2b2c6e97659502023 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:24.570353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550c2bf-843a-4bd2-9cfc-7cff7a5039be None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:24.571230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550c2bf-843a-4bd2-9cfc-7cff7a5039be None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:24.571560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550c2bf-843a-4bd2-9cfc-7cff7a5039be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:24.599823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c550c2bf-843a-4bd2-9cfc-7cff7a5039be None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:24.601744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c550c2bf-843a-4bd2-9cfc-7cff7a5039be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:24.714150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1159/2310] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:14:24.722925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:24.739784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:24.852481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad350-65d9-4b99-820a-9c4401cc862a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:24.857113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d095b-19aa-4f03-b48b-65dc79980846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:24.857940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d095b-19aa-4f03-b48b-65dc79980846 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:24.859367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d095b-19aa-4f03-b48b-65dc79980846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:24.859723 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d095b-19aa-4f03-b48b-65dc79980846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:24.870608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d095b-19aa-4f03-b48b-65dc79980846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:24.872494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d095b-19aa-4f03-b48b-65dc79980846 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:24.898896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1152/2311] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:14:25.225821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550c2bf-843a-4bd2-9cfc-7cff7a5039be None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:25.227266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c550c2bf-843a-4bd2-9cfc-7cff7a5039be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:25.241223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550c2bf-843a-4bd2-9cfc-7cff7a5039be None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:25.246130 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:25.246865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:25.247203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:25.247563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] PATH_INFO: `/v3/projects/4dd433ed860b4fd38c612bc6167561a0` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:25.248827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd433ed860b4fd38c612bc6167561a0)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:25.250846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:25.257856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:25.326804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd433ed860b4fd38c612bc6167561a0', 'request_id': 'req-8190fdc1-c454-4a50-836e-2c7174f880fb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:25.333947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd433ed860b4fd38c612bc6167561a0', 'request_id': 'req-8190fdc1-c454-4a50-836e-2c7174f880fb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:25.343313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd433ed860b4fd38c612bc6167561a0', 'request_id': 'req-8190fdc1-c454-4a50-836e-2c7174f880fb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:25.360866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] The token cache is being invalidate because project 4dd433ed860b4fd38c612bc6167561a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:25.361259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:25.363752 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8190fdc1-c454-4a50-836e-2c7174f880fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:25.368381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1160/2312] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:25 2022] DELETE /identity/v3/projects/4dd433ed860b4fd38c612bc6167561a0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:25.370467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ef08-1b9f-46ed-91a8-17498771e551 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:25.370467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ef08-1b9f-46ed-91a8-17498771e551 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:25.370661 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ef08-1b9f-46ed-91a8-17498771e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:25.402899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a983ef08-1b9f-46ed-91a8-17498771e551 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:25.404175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a983ef08-1b9f-46ed-91a8-17498771e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:25.469891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:25.506585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1153/2313] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:14:25.515654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd7111-ce1b-4ced-8327-bea6a3645b38 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:25.515941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd7111-ce1b-4ced-8327-bea6a3645b38 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:25.516212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd7111-ce1b-4ced-8327-bea6a3645b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:25.550576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6ddd7111-ce1b-4ced-8327-bea6a3645b38 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:25.552820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6ddd7111-ce1b-4ced-8327-bea6a3645b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:25.561814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1161/2314] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:25.566618 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983ef08-1b9f-46ed-91a8-17498771e551 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:25.581384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983ef08-1b9f-46ed-91a8-17498771e551 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:25.590737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09ef42-fdf7-42da-a45d-52246c61c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:25.591802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09ef42-fdf7-42da-a45d-52246c61c9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:25.592201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09ef42-fdf7-42da-a45d-52246c61c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:25.592543 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09ef42-fdf7-42da-a45d-52246c61c9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:25.593703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09ef42-fdf7-42da-a45d-52246c61c9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:14:25.594111 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09ef42-fdf7-42da-a45d-52246c61c9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:25.598429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09ef42-fdf7-42da-a45d-52246c61c9ee admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:25.641148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1154/2315] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:14:25.641900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd7111-ce1b-4ced-8327-bea6a3645b38 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:25.651629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd7111-ce1b-4ced-8327-bea6a3645b38 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:25.656717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f48592-8bf4-4315-993b-549d416ac588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:25.658203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f48592-8bf4-4315-993b-549d416ac588 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:25.658687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f48592-8bf4-4315-993b-549d416ac588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:25.658966 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f48592-8bf4-4315-993b-549d416ac588 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:25.659607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f48592-8bf4-4315-993b-549d416ac588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:25.662345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f48592-8bf4-4315-993b-549d416ac588 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:25.701730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1162/2316] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:14:25 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:14:25.706431 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09ef42-fdf7-42da-a45d-52246c61c9ee admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:25.719998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09ef42-fdf7-42da-a45d-52246c61c9ee admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:25.851943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b0f54-3713-4f4b-a8f4-1cd54651acb4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:25.852232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b0f54-3713-4f4b-a8f4-1cd54651acb4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:25.852511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b0f54-3713-4f4b-a8f4-1cd54651acb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:25.894018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fd9b0f54-3713-4f4b-a8f4-1cd54651acb4 None None] MFA Rules not processed for user `f350a091096742519e5a925ecf3b8ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:25.895419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fd9b0f54-3713-4f4b-a8f4-1cd54651acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:25.897562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7811f-5f65-4af5-bfa8-9a9ade126e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:25.898211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7811f-5f65-4af5-bfa8-9a9ade126e02 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:25.898517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7811f-5f65-4af5-bfa8-9a9ade126e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:25.898790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7811f-5f65-4af5-bfa8-9a9ade126e02 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:25.899440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7811f-5f65-4af5-bfa8-9a9ade126e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:25.901387 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7811f-5f65-4af5-bfa8-9a9ade126e02 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:25.937678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1155/2317] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:14:25 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:25.939672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7811f-5f65-4af5-bfa8-9a9ade126e02 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:25.952410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7811f-5f65-4af5-bfa8-9a9ade126e02 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:25.963823 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844d0b2-e0d6-4091-a828-84864a4ca80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:25.964459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844d0b2-e0d6-4091-a828-84864a4ca80b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:25.964742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844d0b2-e0d6-4091-a828-84864a4ca80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:25.965186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844d0b2-e0d6-4091-a828-84864a4ca80b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:25.966275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844d0b2-e0d6-4091-a828-84864a4ca80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:25.967947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844d0b2-e0d6-4091-a828-84864a4ca80b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:25.981666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1156/2318] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:14:25.985444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844d0b2-e0d6-4091-a828-84864a4ca80b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:25.990727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1163/2319] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:14:25.995530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b0f54-3713-4f4b-a8f4-1cd54651acb4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:25.996525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fd9b0f54-3713-4f4b-a8f4-1cd54651acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:25.999773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844d0b2-e0d6-4091-a828-84864a4ca80b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:26.006674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935cc8-eb87-4d72-aec8-f7c24a7c8070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:26.008125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935cc8-eb87-4d72-aec8-f7c24a7c8070 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:26.008407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935cc8-eb87-4d72-aec8-f7c24a7c8070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:26.008848 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935cc8-eb87-4d72-aec8-f7c24a7c8070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:26.009548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f935cc8-eb87-4d72-aec8-f7c24a7c8070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:26.011245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f935cc8-eb87-4d72-aec8-f7c24a7c8070 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:26.011804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b0f54-3713-4f4b-a8f4-1cd54651acb4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:26.017510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793e5b7-298e-459d-a1bb-14da49cd6446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:26.018623 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793e5b7-298e-459d-a1bb-14da49cd6446 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:26.019245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793e5b7-298e-459d-a1bb-14da49cd6446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:26.019779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793e5b7-298e-459d-a1bb-14da49cd6446 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:26.020623 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793e5b7-298e-459d-a1bb-14da49cd6446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:26.025668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793e5b7-298e-459d-a1bb-14da49cd6446 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:26.032069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1157/2320] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:14:26.039771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935cc8-eb87-4d72-aec8-f7c24a7c8070 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:26.078319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935cc8-eb87-4d72-aec8-f7c24a7c8070 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:26.084528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4bedf-c326-42a4-bb67-bd4d4e846c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:26.085218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4bedf-c326-42a4-bb67-bd4d4e846c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:26.085501 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4bedf-c326-42a4-bb67-bd4d4e846c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:26.085809 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4bedf-c326-42a4-bb67-bd4d4e846c27 admin admin] PATH_INFO: `/v3/projects/428d9e19b3cd42e8a183347daa678f7d/users/4f8ab83983ca44eab21480cae240ba99/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:26.089062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1164/2321] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:14:25 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:26.093232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793e5b7-298e-459d-a1bb-14da49cd6446 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:26.122909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4bedf-c326-42a4-bb67-bd4d4e846c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=428d9e19b3cd42e8a183347daa678f7d, user_id=4f8ab83983ca44eab21480cae240ba99, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:26.125988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4bedf-c326-42a4-bb67-bd4d4e846c27 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:26.141642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1158/2322] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:26 2022] PUT /identity/v3/projects/428d9e19b3cd42e8a183347daa678f7d/users/4f8ab83983ca44eab21480cae240ba99/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:26.142438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:26.153948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fa83d-29cc-4ba7-8461-3f95d3552cab None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:26.154575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fa83d-29cc-4ba7-8461-3f95d3552cab None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:26.155007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fa83d-29cc-4ba7-8461-3f95d3552cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:26.188484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793e5b7-298e-459d-a1bb-14da49cd6446 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:26.192194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-967fa83d-29cc-4ba7-8461-3f95d3552cab None None] MFA Rules not processed for user `4f8ab83983ca44eab21480cae240ba99`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:26.193934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-967fa83d-29cc-4ba7-8461-3f95d3552cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:26.270328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ebcc7-b0d9-4ca0-8c45-1bd8eab21916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:26.270996 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ebcc7-b0d9-4ca0-8c45-1bd8eab21916 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:26.271288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ebcc7-b0d9-4ca0-8c45-1bd8eab21916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:26.271568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ebcc7-b0d9-4ca0-8c45-1bd8eab21916 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:26.272289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ebcc7-b0d9-4ca0-8c45-1bd8eab21916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:26.273704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:26.274248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ebcc7-b0d9-4ca0-8c45-1bd8eab21916 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:26.278215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1159/2323] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:14:26.290828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fa83d-29cc-4ba7-8461-3f95d3552cab None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:26.292226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-967fa83d-29cc-4ba7-8461-3f95d3552cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:26.307007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1165/2324] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:14:26 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:14:26.310995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ebcc7-b0d9-4ca0-8c45-1bd8eab21916 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:26.322734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ebcc7-b0d9-4ca0-8c45-1bd8eab21916 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:26.328266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f1d02-ad02-4fc9-81e4-61c8e33a0ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:26.328913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f1d02-ad02-4fc9-81e4-61c8e33a0ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:26.329176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f1d02-ad02-4fc9-81e4-61c8e33a0ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:26.329446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f1d02-ad02-4fc9-81e4-61c8e33a0ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:26.330691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f1d02-ad02-4fc9-81e4-61c8e33a0ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:26.332670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f1d02-ad02-4fc9-81e4-61c8e33a0ad8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:26.348371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1166/2325] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:14:26.354874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f1d02-ad02-4fc9-81e4-61c8e33a0ad8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:26.360573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fa83d-29cc-4ba7-8461-3f95d3552cab None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:26.366705 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f872-f813-4fa5-b42c-37198a314c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:26.367335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f872-f813-4fa5-b42c-37198a314c11 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:26.367619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f872-f813-4fa5-b42c-37198a314c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:26.367920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f872-f813-4fa5-b42c-37198a314c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:26.370662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f1d02-ad02-4fc9-81e4-61c8e33a0ad8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:26.377962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068f872-f813-4fa5-b42c-37198a314c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:26.379666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068f872-f813-4fa5-b42c-37198a314c11 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:26.382983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0545d65-e32b-4e60-8e56-31e821fc9273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:26.383922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0545d65-e32b-4e60-8e56-31e821fc9273 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:26.384203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0545d65-e32b-4e60-8e56-31e821fc9273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:26.384477 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0545d65-e32b-4e60-8e56-31e821fc9273 admin admin] PATH_INFO: `/v3/projects/d51c95a3122a4db0acb90a502cf7e557/users/24a9cda96ca947cb92e391ddcbddfc6a/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:26.389776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1160/2326] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:14:26.406783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0545d65-e32b-4e60-8e56-31e821fc9273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51c95a3122a4db0acb90a502cf7e557, user_id=24a9cda96ca947cb92e391ddcbddfc6a, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:26.409876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0545d65-e32b-4e60-8e56-31e821fc9273 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:26.429738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1167/2327] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:26 2022] PUT /identity/v3/projects/d51c95a3122a4db0acb90a502cf7e557/users/24a9cda96ca947cb92e391ddcbddfc6a/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:26.434336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f872-f813-4fa5-b42c-37198a314c11 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:26.447202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f872-f813-4fa5-b42c-37198a314c11 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:26.521277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e8602-f306-4f02-bd9f-33f3424f24da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:26.522002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e8602-f306-4f02-bd9f-33f3424f24da admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:26.522290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e8602-f306-4f02-bd9f-33f3424f24da admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:26.522565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e8602-f306-4f02-bd9f-33f3424f24da admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:26.523223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e8602-f306-4f02-bd9f-33f3424f24da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:26.525003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e8602-f306-4f02-bd9f-33f3424f24da admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:26.544694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1161/2328] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:26.551068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0545d65-e32b-4e60-8e56-31e821fc9273 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:26.566586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0545d65-e32b-4e60-8e56-31e821fc9273 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:26.600655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396300e-c7af-40cd-a8bd-e653580e739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:26.601687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396300e-c7af-40cd-a8bd-e653580e739b admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:26.606396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396300e-c7af-40cd-a8bd-e653580e739b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:26.606697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396300e-c7af-40cd-a8bd-e653580e739b admin admin] PATH_INFO: `/v3/projects/d51c95a3122a4db0acb90a502cf7e557/users/24a9cda96ca947cb92e391ddcbddfc6a/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:26.610350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396300e-c7af-40cd-a8bd-e653580e739b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51c95a3122a4db0acb90a502cf7e557, user_id=24a9cda96ca947cb92e391ddcbddfc6a, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:26.616329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396300e-c7af-40cd-a8bd-e653580e739b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:26.639799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1168/2329] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:26 2022] PUT /identity/v3/projects/d51c95a3122a4db0acb90a502cf7e557/users/24a9cda96ca947cb92e391ddcbddfc6a/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:32.148401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e5ee-4791-42be-9a5f-422e5d849b80 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:32.148938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e5ee-4791-42be-9a5f-422e5d849b80 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:32.149460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e5ee-4791-42be-9a5f-422e5d849b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:32.185763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b330e5ee-4791-42be-9a5f-422e5d849b80 None None] MFA Rules not processed for user `24a9cda96ca947cb92e391ddcbddfc6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:32.187405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b330e5ee-4791-42be-9a5f-422e5d849b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:32.295158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1162/2330] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:32.309699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396300e-c7af-40cd-a8bd-e653580e739b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:32.311965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5396300e-c7af-40cd-a8bd-e653580e739b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:32.393992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396300e-c7af-40cd-a8bd-e653580e739b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:32.397687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efaf04-e740-409b-8899-8adc7ed76534 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f20fbf033f04036b48194a804dae8c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:32.398480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efaf04-e740-409b-8899-8adc7ed76534 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:32.398773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efaf04-e740-409b-8899-8adc7ed76534 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:32.399036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efaf04-e740-409b-8899-8adc7ed76534 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:32.449247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:32.522047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efaf04-e740-409b-8899-8adc7ed76534 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:32.524215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efaf04-e740-409b-8899-8adc7ed76534 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:32.552015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1169/2331] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:32.821219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1639ada-eb48-4408-b806-3a8813c888d6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:32.821587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1639ada-eb48-4408-b806-3a8813c888d6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:32.822105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1639ada-eb48-4408-b806-3a8813c888d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:32.844985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c1639ada-eb48-4408-b806-3a8813c888d6 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:32.846752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c1639ada-eb48-4408-b806-3a8813c888d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:32.867922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:32.915037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1163/2332] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:14:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:32.976480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efaf04-e740-409b-8899-8adc7ed76534 service glance] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:32.978099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-74efaf04-e740-409b-8899-8adc7ed76534 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:33.079094 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efaf04-e740-409b-8899-8adc7ed76534 service glance] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:33.084630 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f6144-517b-4a22-a449-551b6770d098 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:33.085782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f6144-517b-4a22-a449-551b6770d098 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:33.086211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f6144-517b-4a22-a449-551b6770d098 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:33.086665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f6144-517b-4a22-a449-551b6770d098 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:33.096098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f6144-517b-4a22-a449-551b6770d098 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:33.097937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f6144-517b-4a22-a449-551b6770d098 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:33.108390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1170/2333] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:14:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:14:38.667927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1639ada-eb48-4408-b806-3a8813c888d6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:38.671566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c1639ada-eb48-4408-b806-3a8813c888d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:38.791689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1639ada-eb48-4408-b806-3a8813c888d6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:38.797287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:38.798112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:38.798520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:38.799006 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] PATH_INFO: `/v3/users/f321a050a58941938db5671890fbd0a0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:38.800765 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f321a050a58941938db5671890fbd0a0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:38.803017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:38.927609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f321a050a58941938db5671890fbd0a0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:38.942365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f321a050a58941938db5671890fbd0a0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:38.942817 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f321a050a58941938db5671890fbd0a0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:38.943934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f321a050a58941938db5671890fbd0a0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:38.965763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f321a050a58941938db5671890fbd0a0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:38.997719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1164/2334] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:38 2022] DELETE /identity/v3/users/f321a050a58941938db5671890fbd0a0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:39.000094 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e458483-9013-4551-8222-710a55b31635 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:39.000699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e458483-9013-4551-8222-710a55b31635 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:39.000802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e458483-9013-4551-8222-710a55b31635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:39.031844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7e458483-9013-4551-8222-710a55b31635 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:39.033247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7e458483-9013-4551-8222-710a55b31635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:39.135845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1171/2335] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:14:39.162919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:39.172075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:39.380675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:39.385034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce61a-7739-4712-8e3d-5812af592a45 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:39.398339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fe980-7055-4744-ad44-10f75f9babed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:39.398974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fe980-7055-4744-ad44-10f75f9babed service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:39.399259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fe980-7055-4744-ad44-10f75f9babed service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:39.399537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fe980-7055-4744-ad44-10f75f9babed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:39.442343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fe980-7055-4744-ad44-10f75f9babed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:39.443807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fe980-7055-4744-ad44-10f75f9babed service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:39.468836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1165/2336] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:39.917188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e458483-9013-4551-8222-710a55b31635 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:39.920063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7e458483-9013-4551-8222-710a55b31635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:39.968734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e458483-9013-4551-8222-710a55b31635 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:39.992121 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:39.993444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:39.994907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:39.995554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] PATH_INFO: `/v3/projects/3439513ebb784916aa472900e15eb79f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:40.006244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3439513ebb784916aa472900e15eb79f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:40.009963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:40.181201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3439513ebb784916aa472900e15eb79f', 'request_id': 'req-c255e206-6567-46a0-ade9-e58688a7963f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:40.194878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3439513ebb784916aa472900e15eb79f', 'request_id': 'req-c255e206-6567-46a0-ade9-e58688a7963f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:40.212421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:40.225889 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3439513ebb784916aa472900e15eb79f', 'request_id': 'req-c255e206-6567-46a0-ade9-e58688a7963f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:40.261263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] The token cache is being invalidate because project 3439513ebb784916aa472900e15eb79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:40.261868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:40.268701 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c255e206-6567-46a0-ade9-e58688a7963f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:40.271432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1172/2337] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:39 2022] DELETE /identity/v3/projects/3439513ebb784916aa472900e15eb79f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:40.277225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234292f2-67fa-4778-aa1f-a6e19c4e1807 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:40.277990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234292f2-67fa-4778-aa1f-a6e19c4e1807 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:40.278655 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234292f2-67fa-4778-aa1f-a6e19c4e1807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:40.347126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-234292f2-67fa-4778-aa1f-a6e19c4e1807 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:40.354004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-234292f2-67fa-4778-aa1f-a6e19c4e1807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:40.477416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1166/2338] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:40.489824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efbb87-9174-4bed-9412-c23ac334576e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:40.490266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efbb87-9174-4bed-9412-c23ac334576e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:40.490688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efbb87-9174-4bed-9412-c23ac334576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:40.560719 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d8efbb87-9174-4bed-9412-c23ac334576e None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:40.563592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d8efbb87-9174-4bed-9412-c23ac334576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:40.595071 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1173/2339] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:40.596310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234292f2-67fa-4778-aa1f-a6e19c4e1807 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:40.611869 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234292f2-67fa-4778-aa1f-a6e19c4e1807 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:40.623100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a550-ea6d-4d65-b166-03f4cac81fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:40.623726 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a550-ea6d-4d65-b166-03f4cac81fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:40.624002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a550-ea6d-4d65-b166-03f4cac81fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:40.624280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a550-ea6d-4d65-b166-03f4cac81fd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:40.628431 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71a550-ea6d-4d65-b166-03f4cac81fd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:14:40.628745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71a550-ea6d-4d65-b166-03f4cac81fd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:40.632227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71a550-ea6d-4d65-b166-03f4cac81fd3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:40.659391 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1167/2340] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:14:40.665319 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efbb87-9174-4bed-9412-c23ac334576e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:40.681080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efbb87-9174-4bed-9412-c23ac334576e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:40.700921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd1444-18c3-443d-a5e3-0df1a97793ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:40.702474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd1444-18c3-443d-a5e3-0df1a97793ce admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:40.703256 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd1444-18c3-443d-a5e3-0df1a97793ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:40.703556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd1444-18c3-443d-a5e3-0df1a97793ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:40.704365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd1444-18c3-443d-a5e3-0df1a97793ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:40.728738 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd1444-18c3-443d-a5e3-0df1a97793ce admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:40.778475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1174/2341] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:14:40 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:40.784908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a550-ea6d-4d65-b166-03f4cac81fd3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:40.807370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a550-ea6d-4d65-b166-03f4cac81fd3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:41.033605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1aaec-4723-4d41-8895-8042ede46af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:41.036161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1aaec-4723-4d41-8895-8042ede46af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:41.037174 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1aaec-4723-4d41-8895-8042ede46af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:41.038004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1aaec-4723-4d41-8895-8042ede46af6 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:41.039870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1aaec-4723-4d41-8895-8042ede46af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:41.044516 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1aaec-4723-4d41-8895-8042ede46af6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:41.092524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1168/2342] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:14:40 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:41.096417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd1444-18c3-443d-a5e3-0df1a97793ce admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:41.108320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd1444-18c3-443d-a5e3-0df1a97793ce admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:41.124296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea419fa9-2c66-45a4-b9a9-8c9b721e85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:41.125044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea419fa9-2c66-45a4-b9a9-8c9b721e85e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:41.125434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea419fa9-2c66-45a4-b9a9-8c9b721e85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:41.125832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea419fa9-2c66-45a4-b9a9-8c9b721e85e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:41.126670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea419fa9-2c66-45a4-b9a9-8c9b721e85e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:41.129222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea419fa9-2c66-45a4-b9a9-8c9b721e85e5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:41.156363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1175/2343] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:41.160519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1aaec-4723-4d41-8895-8042ede46af6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:41.175012 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1aaec-4723-4d41-8895-8042ede46af6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:41.191577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec0b33-2ea1-48c1-beca-15b287986f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:41.192215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec0b33-2ea1-48c1-beca-15b287986f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:41.192504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec0b33-2ea1-48c1-beca-15b287986f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:41.192923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec0b33-2ea1-48c1-beca-15b287986f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:41.193716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec0b33-2ea1-48c1-beca-15b287986f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:41.195354 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec0b33-2ea1-48c1-beca-15b287986f14 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:41.217660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1169/2344] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:41.222254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea419fa9-2c66-45a4-b9a9-8c9b721e85e5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:41.233694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea419fa9-2c66-45a4-b9a9-8c9b721e85e5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:41.247348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f19b54-bdbc-4cb2-a75c-6ff3e8c6923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:41.248574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f19b54-bdbc-4cb2-a75c-6ff3e8c6923d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:41.249017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f19b54-bdbc-4cb2-a75c-6ff3e8c6923d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:41.249463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f19b54-bdbc-4cb2-a75c-6ff3e8c6923d admin admin] PATH_INFO: `/v3/projects/8d6d3d19619845afb8d72ddc1c584669/users/ff789fb006d14f00b5598b1269efd067/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:41.274410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f19b54-bdbc-4cb2-a75c-6ff3e8c6923d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6d3d19619845afb8d72ddc1c584669, user_id=ff789fb006d14f00b5598b1269efd067, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:41.280485 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f19b54-bdbc-4cb2-a75c-6ff3e8c6923d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:41.309488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1176/2345] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:41 2022] PUT /identity/v3/projects/8d6d3d19619845afb8d72ddc1c584669/users/ff789fb006d14f00b5598b1269efd067/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:41.310423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249bdc-0b69-42c0-b1cf-6446aa519f8d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:41.310883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249bdc-0b69-42c0-b1cf-6446aa519f8d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:41.311387 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249bdc-0b69-42c0-b1cf-6446aa519f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:41.360567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7a249bdc-0b69-42c0-b1cf-6446aa519f8d None None] MFA Rules not processed for user `ff789fb006d14f00b5598b1269efd067`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:41.362825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7a249bdc-0b69-42c0-b1cf-6446aa519f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:41.445254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:41.494356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1170/2346] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:41.507224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f19b54-bdbc-4cb2-a75c-6ff3e8c6923d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:41.508955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-66f19b54-bdbc-4cb2-a75c-6ff3e8c6923d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:41.588321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f19b54-bdbc-4cb2-a75c-6ff3e8c6923d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:41.596046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc8381-b5bd-4c89-b722-a6d76a48e906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:41.596828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8381-b5bd-4c89-b722-a6d76a48e906 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:41.597114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8381-b5bd-4c89-b722-a6d76a48e906 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:41.597391 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8381-b5bd-4c89-b722-a6d76a48e906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:41.609116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc8381-b5bd-4c89-b722-a6d76a48e906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:41.610624 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc8381-b5bd-4c89-b722-a6d76a48e906 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:41.633855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1177/2347] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:43.212350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a249bdc-0b69-42c0-b1cf-6446aa519f8d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:43.213958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7a249bdc-0b69-42c0-b1cf-6446aa519f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:43.443748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a249bdc-0b69-42c0-b1cf-6446aa519f8d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:43.507689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:43.521529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:43.522179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:43.522523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] PATH_INFO: `/v3/users/4f8ab83983ca44eab21480cae240ba99` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:43.524727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8ab83983ca44eab21480cae240ba99)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:43.527477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:43.653910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8ab83983ca44eab21480cae240ba99'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:43.677020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8ab83983ca44eab21480cae240ba99'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:43.677833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8ab83983ca44eab21480cae240ba99'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:43.678562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8ab83983ca44eab21480cae240ba99'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:43.690613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8ab83983ca44eab21480cae240ba99'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:43.734612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1171/2348] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:43 2022] DELETE /identity/v3/users/4f8ab83983ca44eab21480cae240ba99 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:43.738967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48d6d-148b-4bc6-892c-bd52c9b438f0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:43.739481 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48d6d-148b-4bc6-892c-bd52c9b438f0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:43.739481 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd48d6d-148b-4bc6-892c-bd52c9b438f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:43.769600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ebd48d6d-148b-4bc6-892c-bd52c9b438f0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:43.770866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ebd48d6d-148b-4bc6-892c-bd52c9b438f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:43.915509 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1178/2349] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:43.925980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:43.927360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:44.021436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6adab-7114-4294-9307-bc3b501b8109 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:44.028371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3c5a9-1700-4b8a-804c-c64ec9b15e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:44.029154 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c5a9-1700-4b8a-804c-c64ec9b15e60 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:44.029513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c5a9-1700-4b8a-804c-c64ec9b15e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:44.029920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c5a9-1700-4b8a-804c-c64ec9b15e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:44.042770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3c5a9-1700-4b8a-804c-c64ec9b15e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:44.044302 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3c5a9-1700-4b8a-804c-c64ec9b15e60 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:44.056322 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1172/2350] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:44.399963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48d6d-148b-4bc6-892c-bd52c9b438f0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:44.401394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ebd48d6d-148b-4bc6-892c-bd52c9b438f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:44.438425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd48d6d-148b-4bc6-892c-bd52c9b438f0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:44.444904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:44.446012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:44.446466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:44.446897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] PATH_INFO: `/v3/projects/428d9e19b3cd42e8a183347daa678f7d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:44.448478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=428d9e19b3cd42e8a183347daa678f7d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:44.450942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:44.479836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:44.513963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428d9e19b3cd42e8a183347daa678f7d', 'request_id': 'req-85d724d1-649a-463f-b91c-33bc2390ea83'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:44.520972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428d9e19b3cd42e8a183347daa678f7d', 'request_id': 'req-85d724d1-649a-463f-b91c-33bc2390ea83'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:44.532729 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428d9e19b3cd42e8a183347daa678f7d', 'request_id': 'req-85d724d1-649a-463f-b91c-33bc2390ea83'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:44.548085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] The token cache is being invalidate because project 428d9e19b3cd42e8a183347daa678f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:44.548574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:44.549890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:44.551516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1179/2351] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:44 2022] DELETE /identity/v3/projects/428d9e19b3cd42e8a183347daa678f7d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:47.755567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba3096-1ad6-4009-9325-2287d99840f9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:47.756169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba3096-1ad6-4009-9325-2287d99840f9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:47.756284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba3096-1ad6-4009-9325-2287d99840f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:47.778588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-54ba3096-1ad6-4009-9325-2287d99840f9 None None] MFA Rules not processed for user `f350a091096742519e5a925ecf3b8ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:47.780514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-54ba3096-1ad6-4009-9325-2287d99840f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:47.786617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:47.854151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1173/2352] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:47.900952 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:47.902452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:47.983449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d724d1-649a-463f-b91c-33bc2390ea83 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:47.990582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:47.991536 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:47.992052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:47.992573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] PATH_INFO: `/v3/users/ff789fb006d14f00b5598b1269efd067` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:47.994665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff789fb006d14f00b5598b1269efd067)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:47.997337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:48.050096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff789fb006d14f00b5598b1269efd067'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:48.058279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff789fb006d14f00b5598b1269efd067'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:48.058937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff789fb006d14f00b5598b1269efd067'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:48.059565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff789fb006d14f00b5598b1269efd067'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:48.068062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff789fb006d14f00b5598b1269efd067'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:48.093324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1180/2353] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:47 2022] DELETE /identity/v3/users/ff789fb006d14f00b5598b1269efd067 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:48.098272 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adfcd3-0a99-4b71-858b-42010e7d1283 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:48.098802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adfcd3-0a99-4b71-858b-42010e7d1283 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:48.099249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adfcd3-0a99-4b71-858b-42010e7d1283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:48.121867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-51adfcd3-0a99-4b71-858b-42010e7d1283 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:48.123258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-51adfcd3-0a99-4b71-858b-42010e7d1283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:48.189729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1174/2354] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:48.205813 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:48.207365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:48.246276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:48.276830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b100-ff84-4061-b42d-a195942b30dd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:48.281539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed87b11-1669-4d50-97a5-add9b8ee12f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:48.282181 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed87b11-1669-4d50-97a5-add9b8ee12f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:48.282461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed87b11-1669-4d50-97a5-add9b8ee12f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:48.282824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed87b11-1669-4d50-97a5-add9b8ee12f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:48.294751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed87b11-1669-4d50-97a5-add9b8ee12f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:48.296108 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed87b11-1669-4d50-97a5-add9b8ee12f1 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:48.306556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1181/2355] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:48.641891 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adfcd3-0a99-4b71-858b-42010e7d1283 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:48.644099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-51adfcd3-0a99-4b71-858b-42010e7d1283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:48.672576 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adfcd3-0a99-4b71-858b-42010e7d1283 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:48.679129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:48.679932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:48.680285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:48.680634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] PATH_INFO: `/v3/projects/8d6d3d19619845afb8d72ddc1c584669` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:48.682136 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6d3d19619845afb8d72ddc1c584669)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:48.683850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:48.742781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6d3d19619845afb8d72ddc1c584669', 'request_id': 'req-26ff08ba-e6e6-4284-94bf-53b776834e96'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:48.750876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6d3d19619845afb8d72ddc1c584669', 'request_id': 'req-26ff08ba-e6e6-4284-94bf-53b776834e96'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:48.759454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6d3d19619845afb8d72ddc1c584669', 'request_id': 'req-26ff08ba-e6e6-4284-94bf-53b776834e96'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:48.779400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] The token cache is being invalidate because project 8d6d3d19619845afb8d72ddc1c584669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:48.779923 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:48.780857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26ff08ba-e6e6-4284-94bf-53b776834e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:48.783232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1175/2356] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:48 2022] DELETE /identity/v3/projects/8d6d3d19619845afb8d72ddc1c584669 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:14:48.788211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320021-b3f9-45d6-9168-b639bbd47182 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:48.788509 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320021-b3f9-45d6-9168-b639bbd47182 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:48.788791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320021-b3f9-45d6-9168-b639bbd47182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:48.824387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f3320021-b3f9-45d6-9168-b639bbd47182 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:48.825533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f3320021-b3f9-45d6-9168-b639bbd47182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:48.895001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1182/2357] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:48.904560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd048-6c30-4aa5-9bff-68f106f4b91f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:48.905401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd048-6c30-4aa5-9bff-68f106f4b91f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:48.906131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd048-6c30-4aa5-9bff-68f106f4b91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:48.928741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-28fdd048-6c30-4aa5-9bff-68f106f4b91f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:48.930252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-28fdd048-6c30-4aa5-9bff-68f106f4b91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:48.942195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1176/2358] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:14:48.946769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3320021-b3f9-45d6-9168-b639bbd47182 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:48.958540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3320021-b3f9-45d6-9168-b639bbd47182 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:48.964039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4aa8c-d5ff-46a8-b2c0-138299e268f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:48.964893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4aa8c-d5ff-46a8-b2c0-138299e268f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:48.965279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4aa8c-d5ff-46a8-b2c0-138299e268f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:48.965693 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4aa8c-d5ff-46a8-b2c0-138299e268f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:48.966641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4aa8c-d5ff-46a8-b2c0-138299e268f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:14:48.967295 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4aa8c-d5ff-46a8-b2c0-138299e268f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:48.969009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4aa8c-d5ff-46a8-b2c0-138299e268f9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:48.982760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1183/2359] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:14:48.987495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd048-6c30-4aa5-9bff-68f106f4b91f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:48.998076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd048-6c30-4aa5-9bff-68f106f4b91f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:49.003467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db8cbe-f16a-494b-82ab-ee6ef84ad9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:49.004067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db8cbe-f16a-494b-82ab-ee6ef84ad9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:49.004347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db8cbe-f16a-494b-82ab-ee6ef84ad9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:49.004620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db8cbe-f16a-494b-82ab-ee6ef84ad9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:49.005256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db8cbe-f16a-494b-82ab-ee6ef84ad9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:49.007173 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db8cbe-f16a-494b-82ab-ee6ef84ad9f7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:49.038492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1177/2360] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:14:48 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:49.042610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4aa8c-d5ff-46a8-b2c0-138299e268f9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:49.056346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4aa8c-d5ff-46a8-b2c0-138299e268f9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:49.125998 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a2f15-03a6-4eeb-8418-cea332185139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:49.127163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2f15-03a6-4eeb-8418-cea332185139 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:49.127446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2f15-03a6-4eeb-8418-cea332185139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:49.127719 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2f15-03a6-4eeb-8418-cea332185139 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:49.128375 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a2f15-03a6-4eeb-8418-cea332185139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:49.130394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a2f15-03a6-4eeb-8418-cea332185139 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:49.151433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1184/2361] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:14:49 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:14:49.155586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db8cbe-f16a-494b-82ab-ee6ef84ad9f7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:49.166045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db8cbe-f16a-494b-82ab-ee6ef84ad9f7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:49.170702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bfc72-ce9c-4c51-85b1-86051ffb77c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:49.171302 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfc72-ce9c-4c51-85b1-86051ffb77c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:49.171587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfc72-ce9c-4c51-85b1-86051ffb77c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:49.171861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfc72-ce9c-4c51-85b1-86051ffb77c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:49.172503 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bfc72-ce9c-4c51-85b1-86051ffb77c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:49.174155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bfc72-ce9c-4c51-85b1-86051ffb77c6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:49.176194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:49.187622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1178/2362] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:14:49.188841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a2f15-03a6-4eeb-8418-cea332185139 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:49.199291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a2f15-03a6-4eeb-8418-cea332185139 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:49.204255 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed098f-14be-433b-805f-da1f7fb12a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:49.205585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed098f-14be-433b-805f-da1f7fb12a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:49.206011 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed098f-14be-433b-805f-da1f7fb12a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:49.206294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed098f-14be-433b-805f-da1f7fb12a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:49.206937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed098f-14be-433b-805f-da1f7fb12a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:49.208532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed098f-14be-433b-805f-da1f7fb12a46 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:49.219118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1185/2363] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:14:49.223288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bfc72-ce9c-4c51-85b1-86051ffb77c6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:49.233347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bfc72-ce9c-4c51-85b1-86051ffb77c6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:49.238032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ecb0d-67a4-4c95-8455-7751ebd31ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:49.238681 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ecb0d-67a4-4c95-8455-7751ebd31ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:49.238969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ecb0d-67a4-4c95-8455-7751ebd31ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:49.239240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ecb0d-67a4-4c95-8455-7751ebd31ac2 admin admin] PATH_INFO: `/v3/projects/0c15101f73e0430fbfa97845127cdd04/users/d57176bb7b264082bfd304036608a5e1/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:49.254220 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ecb0d-67a4-4c95-8455-7751ebd31ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c15101f73e0430fbfa97845127cdd04, user_id=d57176bb7b264082bfd304036608a5e1, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:49.256844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ecb0d-67a4-4c95-8455-7751ebd31ac2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:49.270082 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1179/2364] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:14:49 2022] PUT /identity/v3/projects/0c15101f73e0430fbfa97845127cdd04/users/d57176bb7b264082bfd304036608a5e1/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:49.280609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c032-0545-48a8-a324-f358effa8871 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:49.280954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c032-0545-48a8-a324-f358effa8871 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:49.281229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c032-0545-48a8-a324-f358effa8871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:49.310520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b363c032-0545-48a8-a324-f358effa8871 None None] MFA Rules not processed for user `d57176bb7b264082bfd304036608a5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:49.311771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b363c032-0545-48a8-a324-f358effa8871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:49.341990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:49.379868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1186/2365] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:49.391183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ecb0d-67a4-4c95-8455-7751ebd31ac2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:49.392921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-414ecb0d-67a4-4c95-8455-7751ebd31ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:49.457951 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ecb0d-67a4-4c95-8455-7751ebd31ac2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:49.461930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8625b8d-fb04-4ed9-914f-4e97d9261091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:49.462613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625b8d-fb04-4ed9-914f-4e97d9261091 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:49.462897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625b8d-fb04-4ed9-914f-4e97d9261091 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:49.463177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625b8d-fb04-4ed9-914f-4e97d9261091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:49.472353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8625b8d-fb04-4ed9-914f-4e97d9261091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:49.473830 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8625b8d-fb04-4ed9-914f-4e97d9261091 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:49.483461 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1180/2366] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:51.400615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c032-0545-48a8-a324-f358effa8871 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:51.402054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b363c032-0545-48a8-a324-f358effa8871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:51.468888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c032-0545-48a8-a324-f358effa8871 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:51.474486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08128-0089-4fde-ba23-440cef81420d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:51.475288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08128-0089-4fde-ba23-440cef81420d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:51.475785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08128-0089-4fde-ba23-440cef81420d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:51.476098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08128-0089-4fde-ba23-440cef81420d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:51.478351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f2f08128-0089-4fde-ba23-440cef81420d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:51.554500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f08128-0089-4fde-ba23-440cef81420d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:51.556391 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f08128-0089-4fde-ba23-440cef81420d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:51.565862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de408f28-d1f4-46c6-88df-7177f3dbfe02 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:51.566402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de408f28-d1f4-46c6-88df-7177f3dbfe02 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:51.566633 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de408f28-d1f4-46c6-88df-7177f3dbfe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:51.567476 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1187/2367] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:51.590229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-de408f28-d1f4-46c6-88df-7177f3dbfe02 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:51.591533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-de408f28-d1f4-46c6-88df-7177f3dbfe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:51.667077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1181/2368] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:14:51.679179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08128-0089-4fde-ba23-440cef81420d service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:51.681432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f2f08128-0089-4fde-ba23-440cef81420d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:51.780598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08128-0089-4fde-ba23-440cef81420d service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:51.786451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0e375-6dfb-4571-a3e3-bb6fe16d92d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:51.787072 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e375-6dfb-4571-a3e3-bb6fe16d92d5 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:51.787352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e375-6dfb-4571-a3e3-bb6fe16d92d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:51.787669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e375-6dfb-4571-a3e3-bb6fe16d92d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:51.797186 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0e375-6dfb-4571-a3e3-bb6fe16d92d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:51.799731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0e375-6dfb-4571-a3e3-bb6fe16d92d5 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:51.810477 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1188/2369] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:14:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:14:54.932753 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de408f28-d1f4-46c6-88df-7177f3dbfe02 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:54.934843 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-de408f28-d1f4-46c6-88df-7177f3dbfe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:55.062515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de408f28-d1f4-46c6-88df-7177f3dbfe02 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:55.067748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:55.069752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:55.069752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:55.069752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] PATH_INFO: `/v3/users/0e2d1b7c58eb49f8adf40b0c4a4ec370` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:55.070109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2d1b7c58eb49f8adf40b0c4a4ec370)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:55.072356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:55.107155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:55.151374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2d1b7c58eb49f8adf40b0c4a4ec370'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:55.160641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2d1b7c58eb49f8adf40b0c4a4ec370'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:55.161279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2d1b7c58eb49f8adf40b0c4a4ec370'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:55.161936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2d1b7c58eb49f8adf40b0c4a4ec370'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:55.169535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2d1b7c58eb49f8adf40b0c4a4ec370'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:55.197023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1182/2370] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:54 2022] DELETE /identity/v3/users/0e2d1b7c58eb49f8adf40b0c4a4ec370 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:55.201286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e68ae-af19-4684-9b46-9677214429a8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:55.201787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e68ae-af19-4684-9b46-9677214429a8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:55.201895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e68ae-af19-4684-9b46-9677214429a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:55.222062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e75e68ae-af19-4684-9b46-9677214429a8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:14:55.223371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e75e68ae-af19-4684-9b46-9677214429a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:55.230736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:55.304722 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1189/2371] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:14:55.318560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:55.318560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:55.381418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60718c3e-8735-423f-8bd2-badfc3c9eca1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:55.385030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc93aa-2b89-4857-bcf9-41649f379a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:55.385668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc93aa-2b89-4857-bcf9-41649f379a58 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:55.385952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc93aa-2b89-4857-bcf9-41649f379a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:55.386226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc93aa-2b89-4857-bcf9-41649f379a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:55.399386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc93aa-2b89-4857-bcf9-41649f379a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:55.400841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc93aa-2b89-4857-bcf9-41649f379a58 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:55.425804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1183/2372] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:14:55.813463 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e68ae-af19-4684-9b46-9677214429a8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:55.815715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e75e68ae-af19-4684-9b46-9677214429a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:55.828857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e68ae-af19-4684-9b46-9677214429a8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:55.838361 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:55.839051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:55.839427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:55.839622 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] PATH_INFO: `/v3/projects/16d46d83d86349ad835119e4f99753c3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:55.841170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d46d83d86349ad835119e4f99753c3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:55.852721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:55.916144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d46d83d86349ad835119e4f99753c3', 'request_id': 'req-e4b70611-3adc-496c-ba44-d0858e041f0d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:55.921758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d46d83d86349ad835119e4f99753c3', 'request_id': 'req-e4b70611-3adc-496c-ba44-d0858e041f0d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:55.930808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d46d83d86349ad835119e4f99753c3', 'request_id': 'req-e4b70611-3adc-496c-ba44-d0858e041f0d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:55.942275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] The token cache is being invalidate because project 16d46d83d86349ad835119e4f99753c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:55.942496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:55.944358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4b70611-3adc-496c-ba44-d0858e041f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:55.945906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1190/2373] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:55 2022] DELETE /identity/v3/projects/16d46d83d86349ad835119e4f99753c3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:15:02.208934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc93aa-2b89-4857-bcf9-41649f379a58 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:02.210528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b2cc93aa-2b89-4857-bcf9-41649f379a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:02.224399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc93aa-2b89-4857-bcf9-41649f379a58 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:02.284747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:02.285434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:02.285742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:02.286017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] PATH_INFO: `/v3/users/d57176bb7b264082bfd304036608a5e1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:02.287131 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57176bb7b264082bfd304036608a5e1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:02.289025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:02.335945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:02.337913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57176bb7b264082bfd304036608a5e1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:15:02.346757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57176bb7b264082bfd304036608a5e1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:15:02.347478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57176bb7b264082bfd304036608a5e1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:15:02.348247 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57176bb7b264082bfd304036608a5e1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:15:02.355303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57176bb7b264082bfd304036608a5e1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:15:02.374482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1184/2374] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:15:02 2022] DELETE /identity/v3/users/d57176bb7b264082bfd304036608a5e1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:15:02.379273 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a979d56-8cd9-4e00-9df2-dbdd78c29453 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:02.379835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a979d56-8cd9-4e00-9df2-dbdd78c29453 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:02.379933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a979d56-8cd9-4e00-9df2-dbdd78c29453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:02.399612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6a979d56-8cd9-4e00-9df2-dbdd78c29453 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:15:02.400798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6a979d56-8cd9-4e00-9df2-dbdd78c29453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:02.469945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1191/2375] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:15:02.481382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:02.482875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:02.544674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f4d98-4ca9-4ded-a88c-dd66e697b9bb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:02.548419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3a10c-ef1e-4c78-ae78-e71d3aae1b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:02.549061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3a10c-ef1e-4c78-ae78-e71d3aae1b66 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:02.549332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3a10c-ef1e-4c78-ae78-e71d3aae1b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:02.549631 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3a10c-ef1e-4c78-ae78-e71d3aae1b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:02.558942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3a10c-ef1e-4c78-ae78-e71d3aae1b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:02.560369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3a10c-ef1e-4c78-ae78-e71d3aae1b66 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:02.570314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1185/2376] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:15:02.888435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a979d56-8cd9-4e00-9df2-dbdd78c29453 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:02.890124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6a979d56-8cd9-4e00-9df2-dbdd78c29453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:02.907890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a979d56-8cd9-4e00-9df2-dbdd78c29453 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:02.912646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:02.913278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:02.913563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:02.913864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] PATH_INFO: `/v3/projects/0c15101f73e0430fbfa97845127cdd04` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:02.915195 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c15101f73e0430fbfa97845127cdd04)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:02.917223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:02.958481 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:02.992121 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c15101f73e0430fbfa97845127cdd04', 'request_id': 'req-6b9c1216-b32c-47dd-b707-5c8becb6fe86'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:15:02.999329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c15101f73e0430fbfa97845127cdd04', 'request_id': 'req-6b9c1216-b32c-47dd-b707-5c8becb6fe86'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:15:03.009602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c15101f73e0430fbfa97845127cdd04', 'request_id': 'req-6b9c1216-b32c-47dd-b707-5c8becb6fe86'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:15:03.023006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] The token cache is being invalidate because project 0c15101f73e0430fbfa97845127cdd04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:15:03.023299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:15:03.023977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:15:03.025478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1192/2377] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:15:02 2022] DELETE /identity/v3/projects/0c15101f73e0430fbfa97845127cdd04 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:15:07.763625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3a10c-ef1e-4c78-ae78-e71d3aae1b66 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:07.765021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-43e3a10c-ef1e-4c78-ae78-e71d3aae1b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:07.837074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3a10c-ef1e-4c78-ae78-e71d3aae1b66 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:07.898090 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9438cb-b079-4b9c-bd0a-8a60685134ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:07.898708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9438cb-b079-4b9c-bd0a-8a60685134ae service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:07.898990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9438cb-b079-4b9c-bd0a-8a60685134ae service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:07.899264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9438cb-b079-4b9c-bd0a-8a60685134ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:07.901144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2b9438cb-b079-4b9c-bd0a-8a60685134ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:07.914053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9438cb-b079-4b9c-bd0a-8a60685134ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:07.915641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9438cb-b079-4b9c-bd0a-8a60685134ae service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:07.920549 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:07.928290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1186/2378] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:15:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:15:13.018894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:17.933006 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:22.165892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:22.167300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:22.222901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1216-b32c-47dd-b707-5c8becb6fe86 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:22.226529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d4de-b9d7-4d74-895a-d8b86ed4d346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:22.227134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d4de-b9d7-4d74-895a-d8b86ed4d346 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:22.227413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d4de-b9d7-4d74-895a-d8b86ed4d346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:22.227682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d4de-b9d7-4d74-895a-d8b86ed4d346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:22.229400 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1f17d4de-b9d7-4d74-895a-d8b86ed4d346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:22.296674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17d4de-b9d7-4d74-895a-d8b86ed4d346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:22.298340 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17d4de-b9d7-4d74-895a-d8b86ed4d346 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:22.308226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1193/2379] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:15:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:15:31.907437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b919ac-d4e1-4b65-9e80-8685af172de7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:31.907974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b919ac-d4e1-4b65-9e80-8685af172de7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:31.908069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b919ac-d4e1-4b65-9e80-8685af172de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:31.927182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-85b919ac-d4e1-4b65-9e80-8685af172de7 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:15:31.928366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-85b919ac-d4e1-4b65-9e80-8685af172de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:31.983733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1187/2380] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:15:31.996827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d4de-b9d7-4d74-895a-d8b86ed4d346 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:31.998840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1f17d4de-b9d7-4d74-895a-d8b86ed4d346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:32.071120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d4de-b9d7-4d74-895a-d8b86ed4d346 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:32.076121 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cac6a-518d-4144-ae4a-e0362c3f7b1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:32.076755 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cac6a-518d-4144-ae4a-e0362c3f7b1e service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:32.077029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cac6a-518d-4144-ae4a-e0362c3f7b1e service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:32.077295 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cac6a-518d-4144-ae4a-e0362c3f7b1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:32.088918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cac6a-518d-4144-ae4a-e0362c3f7b1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:32.090570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cac6a-518d-4144-ae4a-e0362c3f7b1e service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:32.099192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1194/2381] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:15:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 12:15:41.976892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=25 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:42.095596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=82 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:49.377932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7caf43-64f2-4f99-8ac2-030b6e06b362 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:49.378642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7caf43-64f2-4f99-8ac2-030b6e06b362 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:49.378642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7caf43-64f2-4f99-8ac2-030b6e06b362 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:49.380142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1188/2382] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:15:49.386139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74d5fc-56ab-4322-870f-8d3f5d48ebe0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:49.386727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74d5fc-56ab-4322-870f-8d3f5d48ebe0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:49.386727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74d5fc-56ab-4322-870f-8d3f5d48ebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:49.409972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1f74d5fc-56ab-4322-870f-8d3f5d48ebe0 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:15:49.411275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1f74d5fc-56ab-4322-870f-8d3f5d48ebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:49.483687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1195/2383] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:15:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:15:49.495981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7caf43-64f2-4f99-8ac2-030b6e06b362 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:49.497738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6b7caf43-64f2-4f99-8ac2-030b6e06b362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:49.556710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7caf43-64f2-4f99-8ac2-030b6e06b362 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:49.560219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86830036-70e1-40ab-b7c8-2e109becfb6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f20fbf033f04036b48194a804dae8c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:49.560814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86830036-70e1-40ab-b7c8-2e109becfb6a service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:49.561091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86830036-70e1-40ab-b7c8-2e109becfb6a service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:49.561359 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86830036-70e1-40ab-b7c8-2e109becfb6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:49.571237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86830036-70e1-40ab-b7c8-2e109becfb6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:49.572675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86830036-70e1-40ab-b7c8-2e109becfb6a service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:49.583437 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1189/2384] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:15:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:15:49.653552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff5d9e-4e8f-4fcd-abf5-47f468c9418a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:49.653867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff5d9e-4e8f-4fcd-abf5-47f468c9418a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:49.654145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff5d9e-4e8f-4fcd-abf5-47f468c9418a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:49.655488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1196/2385] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:15:49.660893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448821af-1c69-4ffc-b395-dfe63f3cd928 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:49.661229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448821af-1c69-4ffc-b395-dfe63f3cd928 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:49.661538 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448821af-1c69-4ffc-b395-dfe63f3cd928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:49.681710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-448821af-1c69-4ffc-b395-dfe63f3cd928 None None] MFA Rules not processed for user `4fe0dabaf0ef4fc7b417d378334413c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:15:49.682946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-448821af-1c69-4ffc-b395-dfe63f3cd928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:49.690578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1190/2386] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:15:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:15:49.702328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff5d9e-4e8f-4fcd-abf5-47f468c9418a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:49.704001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f9ff5d9e-4e8f-4fcd-abf5-47f468c9418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:49.717591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff5d9e-4e8f-4fcd-abf5-47f468c9418a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:49.721418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ca43a-1549-4498-b5a1-269c81ba9d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:49.722035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca43a-1549-4498-b5a1-269c81ba9d4d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:49.722322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca43a-1549-4498-b5a1-269c81ba9d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:49.722594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ca43a-1549-4498-b5a1-269c81ba9d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:49.729584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ca43a-1549-4498-b5a1-269c81ba9d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:49.731012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ca43a-1549-4498-b5a1-269c81ba9d4d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:49.739409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1197/2387] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:15:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:15:49.838680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be08a4-e15e-423a-8ffd-e22094a40a6b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:49.838975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be08a4-e15e-423a-8ffd-e22094a40a6b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:49.839274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be08a4-e15e-423a-8ffd-e22094a40a6b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:49.840701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1191/2388] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:15:49.846733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b856-4746-4e5c-aec1-158677cefbc4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:49.847048 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b856-4746-4e5c-aec1-158677cefbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:49.847355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b856-4746-4e5c-aec1-158677cefbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:49.868297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ab67b856-4746-4e5c-aec1-158677cefbc4 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:15:49.869559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ab67b856-4746-4e5c-aec1-158677cefbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:49.881118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1198/2389] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:15:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:15:49.891558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be08a4-e15e-423a-8ffd-e22094a40a6b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:49.902990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be08a4-e15e-423a-8ffd-e22094a40a6b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:49.906502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341559-850b-4a7a-8bbf-cb99655915ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:49.907087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341559-850b-4a7a-8bbf-cb99655915ff service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:49.907365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341559-850b-4a7a-8bbf-cb99655915ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:49.907635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341559-850b-4a7a-8bbf-cb99655915ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:49.923319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e341559-850b-4a7a-8bbf-cb99655915ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:49.924991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e341559-850b-4a7a-8bbf-cb99655915ff service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:49.936298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1192/2390] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:15:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:15:52.420304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4f664-fe6c-4cce-b78d-46a6b2807ec8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:52.420838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4f664-fe6c-4cce-b78d-46a6b2807ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:52.421028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4f664-fe6c-4cce-b78d-46a6b2807ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:52.442623 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-49c4f664-fe6c-4cce-b78d-46a6b2807ec8 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:15:52.443817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-49c4f664-fe6c-4cce-b78d-46a6b2807ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:52.451117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1199/2391] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:15:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:15:52.463157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341559-850b-4a7a-8bbf-cb99655915ff service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:52.474191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341559-850b-4a7a-8bbf-cb99655915ff service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:52.479104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2eb1d-b6a0-4215-9e22-c4dad964a932 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:52.479689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2eb1d-b6a0-4215-9e22-c4dad964a932 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:52.479990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2eb1d-b6a0-4215-9e22-c4dad964a932 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:52.480248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2eb1d-b6a0-4215-9e22-c4dad964a932 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:52.489080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2eb1d-b6a0-4215-9e22-c4dad964a932 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:52.490706 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2eb1d-b6a0-4215-9e22-c4dad964a932 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:52.498888 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1193/2392] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:15:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:16:02.436270 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=43 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:02.495430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=41 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:15.343584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be628-d999-4cf7-8b6a-652a7385d848 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:16:15.344078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be628-d999-4cf7-8b6a-652a7385d848 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:16:15.344170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be628-d999-4cf7-8b6a-652a7385d848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:16:15.365553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-db9be628-d999-4cf7-8b6a-652a7385d848 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:16:15.366775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-db9be628-d999-4cf7-8b6a-652a7385d848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:16:15.373915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1200/2393] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 19 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:16:15.386209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2eb1d-b6a0-4215-9e22-c4dad964a932 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:16:15.396894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2eb1d-b6a0-4215-9e22-c4dad964a932 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:16:15.402307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5d94b-e2bc-4a1f-9ef2-c16e9d1fddf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:16:15.402900 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5d94b-e2bc-4a1f-9ef2-c16e9d1fddf0 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:16:15.403178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5d94b-e2bc-4a1f-9ef2-c16e9d1fddf0 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:16:15.403446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5d94b-e2bc-4a1f-9ef2-c16e9d1fddf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:16:15.412523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5d94b-e2bc-4a1f-9ef2-c16e9d1fddf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:16:15.414116 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5d94b-e2bc-4a1f-9ef2-c16e9d1fddf0 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:16:15.422278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1194/2394] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:16:25.358563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:25.418902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:40.038348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94412e4-4cc4-4c9b-851b-02477d3a1147 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:16:40.038905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94412e4-4cc4-4c9b-851b-02477d3a1147 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:16:40.038905 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94412e4-4cc4-4c9b-851b-02477d3a1147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:16:40.057209 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c94412e4-4cc4-4c9b-851b-02477d3a1147 None None] MFA Rules not processed for user `cf3436aaf4314c20af0c5816d7809e27`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:16:40.058448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c94412e4-4cc4-4c9b-851b-02477d3a1147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:16:40.112861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1201/2395] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:16:50.106167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=25 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:02.682619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5d94b-e2bc-4a1f-9ef2-c16e9d1fddf0 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:17:02.692002 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5d94b-e2bc-4a1f-9ef2-c16e9d1fddf0 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:17:02.695716 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66648ff-a140-430d-a17a-88b08782e507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:17:02.696308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66648ff-a140-430d-a17a-88b08782e507 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:17:02.697304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66648ff-a140-430d-a17a-88b08782e507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:17:02.697797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66648ff-a140-430d-a17a-88b08782e507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:17:02.699531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a66648ff-a140-430d-a17a-88b08782e507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:02.713390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66648ff-a140-430d-a17a-88b08782e507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:17:02.714836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66648ff-a140-430d-a17a-88b08782e507 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:17:02.725694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1195/2396] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:17:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:17:05.910527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94412e4-4cc4-4c9b-851b-02477d3a1147 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:17:05.920166 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94412e4-4cc4-4c9b-851b-02477d3a1147 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:17:05.923809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c7e18-d852-4b0f-9c58-2e6d10ace90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:17:05.924341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7e18-d852-4b0f-9c58-2e6d10ace90d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:17:05.924616 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7e18-d852-4b0f-9c58-2e6d10ace90d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:17:05.924886 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7e18-d852-4b0f-9c58-2e6d10ace90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:17:05.926598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cd0c7e18-d852-4b0f-9c58-2e6d10ace90d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:05.939819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c7e18-d852-4b0f-9c58-2e6d10ace90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:17:05.941222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c7e18-d852-4b0f-9c58-2e6d10ace90d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:17:05.952417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1202/2397] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:17:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:17:12.720921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:15.947745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:21.581183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66648ff-a140-430d-a17a-88b08782e507 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:17:21.582770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a66648ff-a140-430d-a17a-88b08782e507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:21.596326 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66648ff-a140-430d-a17a-88b08782e507 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:17:21.601926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745629ad-a21a-44ce-b4aa-f24bfc0bbe3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:17:21.603018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745629ad-a21a-44ce-b4aa-f24bfc0bbe3e service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:17:21.603293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745629ad-a21a-44ce-b4aa-f24bfc0bbe3e service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:17:21.603562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745629ad-a21a-44ce-b4aa-f24bfc0bbe3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:17:21.605239 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-745629ad-a21a-44ce-b4aa-f24bfc0bbe3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:21.662494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745629ad-a21a-44ce-b4aa-f24bfc0bbe3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:17:21.664108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745629ad-a21a-44ce-b4aa-f24bfc0bbe3e service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:17:21.673910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1196/2398] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:17:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:17:30.183177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1e0ba-1e79-49fe-99a7-22c3de9a7969 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:17:30.183662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1e0ba-1e79-49fe-99a7-22c3de9a7969 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:17:30.183775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1e0ba-1e79-49fe-99a7-22c3de9a7969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:17:30.203172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-35e1e0ba-1e79-49fe-99a7-22c3de9a7969 None None] MFA Rules not processed for user `2bb68c40e4964cb0b3d74fdf9d91cb2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:17:30.204305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-35e1e0ba-1e79-49fe-99a7-22c3de9a7969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:30.211137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1203/2399] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:17:30.514094 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745629ad-a21a-44ce-b4aa-f24bfc0bbe3e service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:17:30.523144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745629ad-a21a-44ce-b4aa-f24bfc0bbe3e service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:17:30.527463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35d2ed-fcd4-49fa-ae3b-35c8b737ec8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:17:30.528060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35d2ed-fcd4-49fa-ae3b-35c8b737ec8e service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:17:30.528336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35d2ed-fcd4-49fa-ae3b-35c8b737ec8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:17:30.528607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35d2ed-fcd4-49fa-ae3b-35c8b737ec8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:17:30.530335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7b35d2ed-fcd4-49fa-ae3b-35c8b737ec8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:30.540426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35d2ed-fcd4-49fa-ae3b-35c8b737ec8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:17:30.541882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35d2ed-fcd4-49fa-ae3b-35c8b737ec8e service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:17:30.550074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1197/2400] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:17:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:17:30.867411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1e0ba-1e79-49fe-99a7-22c3de9a7969 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:17:30.868939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-35e1e0ba-1e79-49fe-99a7-22c3de9a7969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:30.883448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1e0ba-1e79-49fe-99a7-22c3de9a7969 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:17:30.888516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd7c8-d50b-4147-bd93-aaf00a946ea3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:17:30.889145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd7c8-d50b-4147-bd93-aaf00a946ea3 service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:17:30.889514 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd7c8-d50b-4147-bd93-aaf00a946ea3 service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:17:30.889817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd7c8-d50b-4147-bd93-aaf00a946ea3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:17:30.891545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-47dfd7c8-d50b-4147-bd93-aaf00a946ea3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:30.904407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfd7c8-d50b-4147-bd93-aaf00a946ea3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:17:30.906024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfd7c8-d50b-4147-bd93-aaf00a946ea3 service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:17:30.916902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1204/2401] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:17:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:17:32.847260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35d2ed-fcd4-49fa-ae3b-35c8b737ec8e service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:17:32.856714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35d2ed-fcd4-49fa-ae3b-35c8b737ec8e service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:17:32.860820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c92e55-cd4d-4457-9bfa-331b1ceecb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:17:32.861497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c92e55-cd4d-4457-9bfa-331b1ceecb53 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:17:32.861874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c92e55-cd4d-4457-9bfa-331b1ceecb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:17:32.862222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c92e55-cd4d-4457-9bfa-331b1ceecb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:17:32.864099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a9c92e55-cd4d-4457-9bfa-331b1ceecb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:32.878124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c92e55-cd4d-4457-9bfa-331b1ceecb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:17:32.879565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c92e55-cd4d-4457-9bfa-331b1ceecb53 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:17:32.888750 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1198/2402] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:17:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:17:40.035156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd7c8-d50b-4147-bd93-aaf00a946ea3 service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:17:40.036527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-47dfd7c8-d50b-4147-bd93-aaf00a946ea3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:40.092682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd7c8-d50b-4147-bd93-aaf00a946ea3 service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:17:40.096258 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7d07a-16a9-4d5d-b55a-49a0dc20376f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:17:40.096853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7d07a-16a9-4d5d-b55a-49a0dc20376f service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:17:40.097132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7d07a-16a9-4d5d-b55a-49a0dc20376f service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:17:40.097405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7d07a-16a9-4d5d-b55a-49a0dc20376f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:17:40.099124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-51a7d07a-16a9-4d5d-b55a-49a0dc20376f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:40.110679 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7d07a-16a9-4d5d-b55a-49a0dc20376f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:17:40.112099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7d07a-16a9-4d5d-b55a-49a0dc20376f service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:17:40.121326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1205/2403] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:17:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:17:42.544357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c92e55-cd4d-4457-9bfa-331b1ceecb53 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:17:42.558105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c92e55-cd4d-4457-9bfa-331b1ceecb53 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:17:42.563654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d45220-cfc4-4d9e-b8f0-701e230a09f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:17:42.564255 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d45220-cfc4-4d9e-b8f0-701e230a09f3 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:17:42.564534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d45220-cfc4-4d9e-b8f0-701e230a09f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:17:42.564806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d45220-cfc4-4d9e-b8f0-701e230a09f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:17:42.567102 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e0d45220-cfc4-4d9e-b8f0-701e230a09f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:42.580030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d45220-cfc4-4d9e-b8f0-701e230a09f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:17:42.581937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d45220-cfc4-4d9e-b8f0-701e230a09f3 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:17:42.594283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1199/2404] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:17:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:17:47.543558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7d07a-16a9-4d5d-b55a-49a0dc20376f service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:17:47.561930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7d07a-16a9-4d5d-b55a-49a0dc20376f service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:17:47.567615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef298a69-4b4b-4449-b78c-3fe5da93023f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:17:47.568232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef298a69-4b4b-4449-b78c-3fe5da93023f service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:17:47.568510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef298a69-4b4b-4449-b78c-3fe5da93023f service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:17:47.568782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef298a69-4b4b-4449-b78c-3fe5da93023f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:17:47.570665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ef298a69-4b4b-4449-b78c-3fe5da93023f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:17:47.588225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef298a69-4b4b-4449-b78c-3fe5da93023f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:17:47.589914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef298a69-4b4b-4449-b78c-3fe5da93023f service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:17:47.617886 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1206/2405] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:17:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:17:52.589357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=46 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:57.596884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=41 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:02.373710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d45220-cfc4-4d9e-b8f0-701e230a09f3 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:02.383778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d45220-cfc4-4d9e-b8f0-701e230a09f3 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:02.388379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c501e41-14a1-472d-be58-3455a7449dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:02.388978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501e41-14a1-472d-be58-3455a7449dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:02.389259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501e41-14a1-472d-be58-3455a7449dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:02.389527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501e41-14a1-472d-be58-3455a7449dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:02.391352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0c501e41-14a1-472d-be58-3455a7449dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:02.453684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c501e41-14a1-472d-be58-3455a7449dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:02.455099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c501e41-14a1-472d-be58-3455a7449dd9 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:02.464770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1200/2406] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:02.854521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef298a69-4b4b-4449-b78c-3fe5da93023f service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:02.869530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef298a69-4b4b-4449-b78c-3fe5da93023f service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:02.882372 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323656c-ba7d-49d5-8a01-bfa15385b4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:02.884254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323656c-ba7d-49d5-8a01-bfa15385b4e7 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:02.886464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323656c-ba7d-49d5-8a01-bfa15385b4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:02.888100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323656c-ba7d-49d5-8a01-bfa15385b4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:02.892012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3323656c-ba7d-49d5-8a01-bfa15385b4e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:02.929390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323656c-ba7d-49d5-8a01-bfa15385b4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:02.931181 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323656c-ba7d-49d5-8a01-bfa15385b4e7 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:02.964540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1207/2407] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:05.813308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c501e41-14a1-472d-be58-3455a7449dd9 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:05.814836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0c501e41-14a1-472d-be58-3455a7449dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:05.827667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c501e41-14a1-472d-be58-3455a7449dd9 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:05.832242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:05.832857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:05.833135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:05.833413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] PATH_INFO: `/v3/users/cf3436aaf4314c20af0c5816d7809e27` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:05.834572 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3436aaf4314c20af0c5816d7809e27)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:05.836470 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:05.880853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3436aaf4314c20af0c5816d7809e27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:05.888620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3436aaf4314c20af0c5816d7809e27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:05.889230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3436aaf4314c20af0c5816d7809e27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:05.889858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3436aaf4314c20af0c5816d7809e27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:05.896792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6887c067-6e4c-43bd-bc88-04f6b397742a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3436aaf4314c20af0c5816d7809e27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:05.916282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1201/2408] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:18:05 2022] DELETE /identity/v3/users/cf3436aaf4314c20af0c5816d7809e27 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:06.094677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323656c-ba7d-49d5-8a01-bfa15385b4e7 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:06.105608 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323656c-ba7d-49d5-8a01-bfa15385b4e7 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:06.163117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:06.163835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.164103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.164387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] PATH_INFO: `/v3/projects/c98e13eabf414dbea2092f44573a0db4` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.165730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98e13eabf414dbea2092f44573a0db4)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:06.168116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:06.213958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98e13eabf414dbea2092f44573a0db4', 'request_id': 'req-4455b184-4446-48e7-9b7b-14b9b392f930'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:06.219344 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98e13eabf414dbea2092f44573a0db4', 'request_id': 'req-4455b184-4446-48e7-9b7b-14b9b392f930'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:06.226961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98e13eabf414dbea2092f44573a0db4', 'request_id': 'req-4455b184-4446-48e7-9b7b-14b9b392f930'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:06.238282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] The token cache is being invalidate because project c98e13eabf414dbea2092f44573a0db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:18:06.238563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:06.239179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4455b184-4446-48e7-9b7b-14b9b392f930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:06.240628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1208/2409] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:18:06 2022] DELETE /identity/v3/projects/c98e13eabf414dbea2092f44573a0db4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:06.246195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65c58-c9e4-468e-928f-aab49f43c20d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.246484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65c58-c9e4-468e-928f-aab49f43c20d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.246763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65c58-c9e4-468e-928f-aab49f43c20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.267060 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1bd65c58-c9e4-468e-928f-aab49f43c20d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:06.268188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1bd65c58-c9e4-468e-928f-aab49f43c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:06.328707 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1202/2410] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:18:06.336563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b44ec-1dc3-4003-acc5-dd928c7a1b98 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.336848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b44ec-1dc3-4003-acc5-dd928c7a1b98 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.337122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b44ec-1dc3-4003-acc5-dd928c7a1b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.356659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2e0b44ec-1dc3-4003-acc5-dd928c7a1b98 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:06.357888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2e0b44ec-1dc3-4003-acc5-dd928c7a1b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:06.365962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1209/2411] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:06.370762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd65c58-c9e4-468e-928f-aab49f43c20d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:06.380173 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd65c58-c9e4-468e-928f-aab49f43c20d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:06.384679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5da2a-dd70-4c3c-aa20-625cde99c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:06.385916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5da2a-dd70-4c3c-aa20-625cde99c5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.386409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5da2a-dd70-4c3c-aa20-625cde99c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.386701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5da2a-dd70-4c3c-aa20-625cde99c5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.387347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5da2a-dd70-4c3c-aa20-625cde99c5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:18:06.387649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5da2a-dd70-4c3c-aa20-625cde99c5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:06.389256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5da2a-dd70-4c3c-aa20-625cde99c5e8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:06.390807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:06.403121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1203/2412] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:18:06.407416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b44ec-1dc3-4003-acc5-dd928c7a1b98 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:06.417272 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b44ec-1dc3-4003-acc5-dd928c7a1b98 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:06.421914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff0cb5-1e12-43d5-8993-626221bceb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:06.422505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff0cb5-1e12-43d5-8993-626221bceb68 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.422786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff0cb5-1e12-43d5-8993-626221bceb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.423060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff0cb5-1e12-43d5-8993-626221bceb68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.423694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff0cb5-1e12-43d5-8993-626221bceb68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:06.425568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff0cb5-1e12-43d5-8993-626221bceb68 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:06.452633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1210/2413] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:18:06 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:18:06.456875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5da2a-dd70-4c3c-aa20-625cde99c5e8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:06.466842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5da2a-dd70-4c3c-aa20-625cde99c5e8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:06.524208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ced5b3-8303-4354-9b62-af7c907fac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:06.524779 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ced5b3-8303-4354-9b62-af7c907fac9a admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.525099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ced5b3-8303-4354-9b62-af7c907fac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.525375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ced5b3-8303-4354-9b62-af7c907fac9a admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.526341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ced5b3-8303-4354-9b62-af7c907fac9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:06.528458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ced5b3-8303-4354-9b62-af7c907fac9a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:06.550403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1204/2414] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:18:06 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:18:06.554808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff0cb5-1e12-43d5-8993-626221bceb68 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:06.566107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff0cb5-1e12-43d5-8993-626221bceb68 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:06.570819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f51641-8e11-44a1-a595-6d84e2993ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:06.571448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51641-8e11-44a1-a595-6d84e2993ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.571749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51641-8e11-44a1-a595-6d84e2993ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.572026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51641-8e11-44a1-a595-6d84e2993ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.572735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f51641-8e11-44a1-a595-6d84e2993ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:06.574772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f51641-8e11-44a1-a595-6d84e2993ec9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:06.584852 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1211/2415] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:18:06.588901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ced5b3-8303-4354-9b62-af7c907fac9a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:06.598867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ced5b3-8303-4354-9b62-af7c907fac9a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:06.603497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953b373-e264-4bb1-81cf-7091ca19e2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:06.604740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953b373-e264-4bb1-81cf-7091ca19e2fd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.605211 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953b373-e264-4bb1-81cf-7091ca19e2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.605496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953b373-e264-4bb1-81cf-7091ca19e2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.606189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953b373-e264-4bb1-81cf-7091ca19e2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:06.607774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953b373-e264-4bb1-81cf-7091ca19e2fd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:06.618664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1205/2416] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:18:06.623435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f51641-8e11-44a1-a595-6d84e2993ec9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:06.633458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f51641-8e11-44a1-a595-6d84e2993ec9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:06.638557 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b54fb-b7df-4758-b1eb-4e1123a19339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:06.639206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b54fb-b7df-4758-b1eb-4e1123a19339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.639502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b54fb-b7df-4758-b1eb-4e1123a19339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.639779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b54fb-b7df-4758-b1eb-4e1123a19339 admin admin] PATH_INFO: `/v3/projects/5ecad92fe27e4476a4cc8944aa8c9401/users/6a2bf6d86bc34257b94bd44576463c3f/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.655148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b54fb-b7df-4758-b1eb-4e1123a19339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecad92fe27e4476a4cc8944aa8c9401, user_id=6a2bf6d86bc34257b94bd44576463c3f, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:06.657928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b54fb-b7df-4758-b1eb-4e1123a19339 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:06.679639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1212/2417] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:18:06 2022] PUT /identity/v3/projects/5ecad92fe27e4476a4cc8944aa8c9401/users/6a2bf6d86bc34257b94bd44576463c3f/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:06.690422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35097e5a-3d8d-4352-ba2d-bf482008482e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.690709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35097e5a-3d8d-4352-ba2d-bf482008482e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.690985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35097e5a-3d8d-4352-ba2d-bf482008482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.719739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-35097e5a-3d8d-4352-ba2d-bf482008482e None None] MFA Rules not processed for user `6a2bf6d86bc34257b94bd44576463c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:06.721046 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-35097e5a-3d8d-4352-ba2d-bf482008482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:06.797774 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1206/2418] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:06.798392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b54fb-b7df-4758-b1eb-4e1123a19339 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:06.815534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:06.889702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b54fb-b7df-4758-b1eb-4e1123a19339 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:06.895033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cbb39-30b9-4881-bf32-6115a0e093a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:06.895645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cbb39-30b9-4881-bf32-6115a0e093a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:06.895933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cbb39-30b9-4881-bf32-6115a0e093a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:06.896213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cbb39-30b9-4881-bf32-6115a0e093a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:06.896856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cbb39-30b9-4881-bf32-6115a0e093a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:06.898793 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cbb39-30b9-4881-bf32-6115a0e093a7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:06.935168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1213/2419] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:18:06 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:18:06.936424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35097e5a-3d8d-4352-ba2d-bf482008482e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:06.947391 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35097e5a-3d8d-4352-ba2d-bf482008482e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:07.005664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08544da1-7760-45fe-b4f2-84fe4fcf28df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:07.006306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08544da1-7760-45fe-b4f2-84fe4fcf28df admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:07.006591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08544da1-7760-45fe-b4f2-84fe4fcf28df admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:07.006892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08544da1-7760-45fe-b4f2-84fe4fcf28df admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:07.007515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08544da1-7760-45fe-b4f2-84fe4fcf28df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:07.009455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08544da1-7760-45fe-b4f2-84fe4fcf28df admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:07.018627 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:07.032559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1207/2420] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:18:06 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:18:07.036689 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cbb39-30b9-4881-bf32-6115a0e093a7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:07.047386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cbb39-30b9-4881-bf32-6115a0e093a7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:07.052331 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a25fc3-8864-4126-a78f-5b1fbb615e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:07.052923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a25fc3-8864-4126-a78f-5b1fbb615e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:07.053205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a25fc3-8864-4126-a78f-5b1fbb615e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:07.053478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a25fc3-8864-4126-a78f-5b1fbb615e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:07.054142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a25fc3-8864-4126-a78f-5b1fbb615e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:07.055728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a25fc3-8864-4126-a78f-5b1fbb615e99 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:07.067123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1214/2421] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:18:07.071237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08544da1-7760-45fe-b4f2-84fe4fcf28df admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:07.081232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08544da1-7760-45fe-b4f2-84fe4fcf28df admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:07.085850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b14da-598f-41af-8133-225ce821e1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:07.086487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b14da-598f-41af-8133-225ce821e1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:07.086768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b14da-598f-41af-8133-225ce821e1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:07.087048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b14da-598f-41af-8133-225ce821e1e9 admin admin] PATH_INFO: `/v3/projects/ed519dea749b440ead53a22240c67f31/users/e9f440eb1a574416be29584b362af7f5/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:07.103698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b14da-598f-41af-8133-225ce821e1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed519dea749b440ead53a22240c67f31, user_id=e9f440eb1a574416be29584b362af7f5, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:07.106997 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b14da-598f-41af-8133-225ce821e1e9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:07.120438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1208/2422] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:18:07 2022] PUT /identity/v3/projects/ed519dea749b440ead53a22240c67f31/users/e9f440eb1a574416be29584b362af7f5/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:07.124308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a25fc3-8864-4126-a78f-5b1fbb615e99 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:07.134402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a25fc3-8864-4126-a78f-5b1fbb615e99 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:07.190431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d19a2-4648-4191-97c3-ef33ca8aec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:07.191037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d19a2-4648-4191-97c3-ef33ca8aec1c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:07.191313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d19a2-4648-4191-97c3-ef33ca8aec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:07.191585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d19a2-4648-4191-97c3-ef33ca8aec1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:07.192221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d19a2-4648-4191-97c3-ef33ca8aec1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:07.193824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d19a2-4648-4191-97c3-ef33ca8aec1c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:07.203418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1215/2423] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:18:07.207569 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b14da-598f-41af-8133-225ce821e1e9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:07.222392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b14da-598f-41af-8133-225ce821e1e9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:07.227023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742a962-5665-4cb9-bee9-043b22ebddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:07.227671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742a962-5665-4cb9-bee9-043b22ebddee admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:07.227945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742a962-5665-4cb9-bee9-043b22ebddee admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:07.228214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742a962-5665-4cb9-bee9-043b22ebddee admin admin] PATH_INFO: `/v3/projects/ed519dea749b440ead53a22240c67f31/users/e9f440eb1a574416be29584b362af7f5/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:07.236248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742a962-5665-4cb9-bee9-043b22ebddee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed519dea749b440ead53a22240c67f31, user_id=e9f440eb1a574416be29584b362af7f5, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:07.238875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742a962-5665-4cb9-bee9-043b22ebddee admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:07.250018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1209/2424] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:18:07 2022] PUT /identity/v3/projects/ed519dea749b440ead53a22240c67f31/users/e9f440eb1a574416be29584b362af7f5/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:07.261689 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e256a-6c40-46fe-8da2-80fcf45b3032 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:07.261986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e256a-6c40-46fe-8da2-80fcf45b3032 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:07.262270 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e256a-6c40-46fe-8da2-80fcf45b3032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:07.291093 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ba6e256a-6c40-46fe-8da2-80fcf45b3032 None None] MFA Rules not processed for user `e9f440eb1a574416be29584b362af7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:07.293014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ba6e256a-6c40-46fe-8da2-80fcf45b3032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:07.364525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1216/2425] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:07.377686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742a962-5665-4cb9-bee9-043b22ebddee admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:07.379427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2742a962-5665-4cb9-bee9-043b22ebddee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:07.438548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742a962-5665-4cb9-bee9-043b22ebddee admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:07.443320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a8bad-335f-4eee-922a-496457ea21b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:07.443934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a8bad-335f-4eee-922a-496457ea21b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:07.444207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a8bad-335f-4eee-922a-496457ea21b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:07.444473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a8bad-335f-4eee-922a-496457ea21b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:07.454170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a8bad-335f-4eee-922a-496457ea21b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:07.455643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a8bad-335f-4eee-922a-496457ea21b3 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:07.466271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1210/2426] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:07.884699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e256a-6c40-46fe-8da2-80fcf45b3032 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:07.894864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:07.949747 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e256a-6c40-46fe-8da2-80fcf45b3032 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:07.954204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:07.954851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:07.955113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:07.955393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] PATH_INFO: `/v3/users/6a2bf6d86bc34257b94bd44576463c3f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:07.956464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2bf6d86bc34257b94bd44576463c3f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:07.958456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:08.006237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2bf6d86bc34257b94bd44576463c3f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.014305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2bf6d86bc34257b94bd44576463c3f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.014932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2bf6d86bc34257b94bd44576463c3f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.015777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2bf6d86bc34257b94bd44576463c3f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.023214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2bf6d86bc34257b94bd44576463c3f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.041346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1217/2427] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:18:07 2022] DELETE /identity/v3/users/6a2bf6d86bc34257b94bd44576463c3f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:08.045975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc757-67dd-4e08-96f0-929965cfade2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:08.046446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc757-67dd-4e08-96f0-929965cfade2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:08.046559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc757-67dd-4e08-96f0-929965cfade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:08.066003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2d3bc757-67dd-4e08-96f0-929965cfade2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:08.067190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2d3bc757-67dd-4e08-96f0-929965cfade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:08.127772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1211/2428] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:08.138349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:08.139780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:08.197154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c38168-2550-4808-92af-35b86ca58c15 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:08.201396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cadbd0-ab99-4ee1-ba96-a0c52e9732a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:08.202023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cadbd0-ab99-4ee1-ba96-a0c52e9732a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:08.202304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cadbd0-ab99-4ee1-ba96-a0c52e9732a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:08.202578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cadbd0-ab99-4ee1-ba96-a0c52e9732a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:08.211504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cadbd0-ab99-4ee1-ba96-a0c52e9732a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:08.212927 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cadbd0-ab99-4ee1-ba96-a0c52e9732a2 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:08.222957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1218/2429] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:08.485953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc757-67dd-4e08-96f0-929965cfade2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:08.487375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2d3bc757-67dd-4e08-96f0-929965cfade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:08.500924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc757-67dd-4e08-96f0-929965cfade2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:08.506585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:08.507229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:08.507512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:08.507781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] PATH_INFO: `/v3/projects/5ecad92fe27e4476a4cc8944aa8c9401` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:08.508917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecad92fe27e4476a4cc8944aa8c9401)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:08.511532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:08.559969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecad92fe27e4476a4cc8944aa8c9401', 'request_id': 'req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.562448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:08.567251 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecad92fe27e4476a4cc8944aa8c9401', 'request_id': 'req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.574009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecad92fe27e4476a4cc8944aa8c9401', 'request_id': 'req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.585685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] The token cache is being invalidate because project 5ecad92fe27e4476a4cc8944aa8c9401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:18:08.585972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.586599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.588055 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1212/2430] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:18:08 2022] DELETE /identity/v3/projects/5ecad92fe27e4476a4cc8944aa8c9401 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:08.592673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cadbd0-ab99-4ee1-ba96-a0c52e9732a2 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:08.602276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cadbd0-ab99-4ee1-ba96-a0c52e9732a2 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:08.631100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:08.661349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:08.661895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:08.662171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:08.662628 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] PATH_INFO: `/v3/users/e9f440eb1a574416be29584b362af7f5` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:08.663683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f440eb1a574416be29584b362af7f5)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:08.665645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:08.720953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f440eb1a574416be29584b362af7f5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.728050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f440eb1a574416be29584b362af7f5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.728705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f440eb1a574416be29584b362af7f5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.729385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f440eb1a574416be29584b362af7f5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.736652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-86f06c2e-2d50-45b2-bbd1-661fd5add81b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f440eb1a574416be29584b362af7f5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:08.754777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1219/2431] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:18:08 2022] DELETE /identity/v3/users/e9f440eb1a574416be29584b362af7f5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:09.034463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:09.035902 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:09.054582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3e04e-b1b0-46f2-b4bf-4dfcbb7c6ec8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:09.118533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:09.119198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.119514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.119787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] PATH_INFO: `/v3/projects/ed519dea749b440ead53a22240c67f31` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.120974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed519dea749b440ead53a22240c67f31)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:09.122971 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:09.178156 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed519dea749b440ead53a22240c67f31', 'request_id': 'req-63b8117b-b877-41eb-9bc7-ea4d7602b45c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:09.186912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed519dea749b440ead53a22240c67f31', 'request_id': 'req-63b8117b-b877-41eb-9bc7-ea4d7602b45c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:09.199457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed519dea749b440ead53a22240c67f31', 'request_id': 'req-63b8117b-b877-41eb-9bc7-ea4d7602b45c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:09.212057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] The token cache is being invalidate because project ed519dea749b440ead53a22240c67f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:18:09.212343 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:09.212993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-63b8117b-b877-41eb-9bc7-ea4d7602b45c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:09.214996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1213/2432] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:18:09 2022] DELETE /identity/v3/projects/ed519dea749b440ead53a22240c67f31 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:09.219646 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d797-b785-4c14-9599-67fccfb26966 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.220136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d797-b785-4c14-9599-67fccfb26966 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.220588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d797-b785-4c14-9599-67fccfb26966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.240427 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6b83d797-b785-4c14-9599-67fccfb26966 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:09.241675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6b83d797-b785-4c14-9599-67fccfb26966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:09.314409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1220/2433] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:09.322497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07c62f-970c-4787-b280-cf9922d19f67 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.323638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07c62f-970c-4787-b280-cf9922d19f67 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.324216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07c62f-970c-4787-b280-cf9922d19f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.345814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dd07c62f-970c-4787-b280-cf9922d19f67 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:09.347200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dd07c62f-970c-4787-b280-cf9922d19f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:09.356537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1214/2434] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:18:09.361202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d797-b785-4c14-9599-67fccfb26966 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:09.371917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d797-b785-4c14-9599-67fccfb26966 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:09.376495 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2df15-c9e1-4d9d-ab4a-189eec3bf930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:09.377089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2df15-c9e1-4d9d-ab4a-189eec3bf930 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.377370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2df15-c9e1-4d9d-ab4a-189eec3bf930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.377683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2df15-c9e1-4d9d-ab4a-189eec3bf930 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.378333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2df15-c9e1-4d9d-ab4a-189eec3bf930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:18:09.378639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2df15-c9e1-4d9d-ab4a-189eec3bf930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:09.380225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2df15-c9e1-4d9d-ab4a-189eec3bf930 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:09.392325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1221/2435] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:18:09.396573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07c62f-970c-4787-b280-cf9922d19f67 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:09.405909 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07c62f-970c-4787-b280-cf9922d19f67 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:09.410541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f548fa4-9d8f-4845-89c5-1617414f0291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:09.411124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f548fa4-9d8f-4845-89c5-1617414f0291 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.411400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f548fa4-9d8f-4845-89c5-1617414f0291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.411672 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f548fa4-9d8f-4845-89c5-1617414f0291 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.412300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f548fa4-9d8f-4845-89c5-1617414f0291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:09.414226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f548fa4-9d8f-4845-89c5-1617414f0291 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:09.442398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1215/2436] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:18:09 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:18:09.446496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2df15-c9e1-4d9d-ab4a-189eec3bf930 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:09.456451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2df15-c9e1-4d9d-ab4a-189eec3bf930 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:09.490127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:09.516629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbdb24-40ce-4ba9-a095-a29b73f80e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:09.517223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbdb24-40ce-4ba9-a095-a29b73f80e96 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.517500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbdb24-40ce-4ba9-a095-a29b73f80e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.517806 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbdb24-40ce-4ba9-a095-a29b73f80e96 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.518435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbdb24-40ce-4ba9-a095-a29b73f80e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:09.520597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbdb24-40ce-4ba9-a095-a29b73f80e96 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:09.540290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1222/2437] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:18:09 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:18:09.544927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f548fa4-9d8f-4845-89c5-1617414f0291 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:09.555175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f548fa4-9d8f-4845-89c5-1617414f0291 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:09.560569 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a2fb8-ef98-4155-86b5-4fa86e7392d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:09.561162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a2fb8-ef98-4155-86b5-4fa86e7392d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.561490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a2fb8-ef98-4155-86b5-4fa86e7392d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.561794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a2fb8-ef98-4155-86b5-4fa86e7392d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.562423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a2fb8-ef98-4155-86b5-4fa86e7392d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:09.564049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a2fb8-ef98-4155-86b5-4fa86e7392d0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:09.573960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1216/2438] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:18:09.578026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbdb24-40ce-4ba9-a095-a29b73f80e96 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:09.587963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbdb24-40ce-4ba9-a095-a29b73f80e96 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:09.592735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ac1d2-be3c-4cba-b67f-1bf46dcfb69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:09.593325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ac1d2-be3c-4cba-b67f-1bf46dcfb69d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.593605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ac1d2-be3c-4cba-b67f-1bf46dcfb69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.593911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ac1d2-be3c-4cba-b67f-1bf46dcfb69d admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.594568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ac1d2-be3c-4cba-b67f-1bf46dcfb69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:09.596158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ac1d2-be3c-4cba-b67f-1bf46dcfb69d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:09.607851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1223/2439] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:18:09.612398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a2fb8-ef98-4155-86b5-4fa86e7392d0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:09.623798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a2fb8-ef98-4155-86b5-4fa86e7392d0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:09.628355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97bbb4-0f3a-434d-afb8-b3b4edf85aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:09.629004 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97bbb4-0f3a-434d-afb8-b3b4edf85aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.629288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97bbb4-0f3a-434d-afb8-b3b4edf85aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.629567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97bbb4-0f3a-434d-afb8-b3b4edf85aa8 admin admin] PATH_INFO: `/v3/projects/d8a70b5db7f9442580b40b6492e3ec78/users/53ea0154cb954a11be77b7be77db2604/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.644547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97bbb4-0f3a-434d-afb8-b3b4edf85aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a70b5db7f9442580b40b6492e3ec78, user_id=53ea0154cb954a11be77b7be77db2604, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:09.647760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97bbb4-0f3a-434d-afb8-b3b4edf85aa8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:09.661748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1217/2440] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:18:09 2022] PUT /identity/v3/projects/d8a70b5db7f9442580b40b6492e3ec78/users/53ea0154cb954a11be77b7be77db2604/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:18:09.672731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9457ac-adab-47d7-a07e-5accdc992ec5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.673016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9457ac-adab-47d7-a07e-5accdc992ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.673287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9457ac-adab-47d7-a07e-5accdc992ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.701849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2f9457ac-adab-47d7-a07e-5accdc992ec5 None None] MFA Rules not processed for user `53ea0154cb954a11be77b7be77db2604`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:09.703052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2f9457ac-adab-47d7-a07e-5accdc992ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:09.765987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1224/2441] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:09.770482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97bbb4-0f3a-434d-afb8-b3b4edf85aa8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:09.779911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:09.834553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97bbb4-0f3a-434d-afb8-b3b4edf85aa8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:09.839703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581778b5-9402-480d-864d-a1b040d36f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:09.840304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581778b5-9402-480d-864d-a1b040d36f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.840583 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581778b5-9402-480d-864d-a1b040d36f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.840863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581778b5-9402-480d-864d-a1b040d36f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.841496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581778b5-9402-480d-864d-a1b040d36f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:09.843421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581778b5-9402-480d-864d-a1b040d36f41 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:09.871143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1218/2442] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:18:09 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:18:09.875215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9457ac-adab-47d7-a07e-5accdc992ec5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:09.886009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9457ac-adab-47d7-a07e-5accdc992ec5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:09.948076 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aeebf-b0a2-447a-9757-55640694b10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:09.948687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aeebf-b0a2-447a-9757-55640694b10c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.948972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aeebf-b0a2-447a-9757-55640694b10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.949248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aeebf-b0a2-447a-9757-55640694b10c admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.949910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aeebf-b0a2-447a-9757-55640694b10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:09.951828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aeebf-b0a2-447a-9757-55640694b10c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:09.973261 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1225/2443] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:18:09 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:18:09.977367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581778b5-9402-480d-864d-a1b040d36f41 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:09.988458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581778b5-9402-480d-864d-a1b040d36f41 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:09.993262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23e362-afa5-4842-832c-696a208f0817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:09.993901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23e362-afa5-4842-832c-696a208f0817 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:09.994193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23e362-afa5-4842-832c-696a208f0817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:09.994508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23e362-afa5-4842-832c-696a208f0817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:09.995192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23e362-afa5-4842-832c-696a208f0817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:09.996794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23e362-afa5-4842-832c-696a208f0817 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:10.008221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1219/2444] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:18:10.012356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aeebf-b0a2-447a-9757-55640694b10c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:10.022304 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aeebf-b0a2-447a-9757-55640694b10c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:10.027647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea86c4-a281-4d67-9b76-d49039450b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:10.028315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea86c4-a281-4d67-9b76-d49039450b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:10.028600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea86c4-a281-4d67-9b76-d49039450b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:10.028876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea86c4-a281-4d67-9b76-d49039450b05 admin admin] PATH_INFO: `/v3/projects/4b09c1d14eaa4688b088d6a70b99d371/users/3e92a823767b455195914567ae8bdc03/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:10.044022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea86c4-a281-4d67-9b76-d49039450b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b09c1d14eaa4688b088d6a70b99d371, user_id=3e92a823767b455195914567ae8bdc03, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:10.046697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea86c4-a281-4d67-9b76-d49039450b05 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:10.059473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1226/2445] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:18:10 2022] PUT /identity/v3/projects/4b09c1d14eaa4688b088d6a70b99d371/users/3e92a823767b455195914567ae8bdc03/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:10.063560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23e362-afa5-4842-832c-696a208f0817 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:10.073536 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23e362-afa5-4842-832c-696a208f0817 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:10.130603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bd37c-88f8-4014-a260-b4309f461d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:10.131124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bd37c-88f8-4014-a260-b4309f461d4d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:10.131408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bd37c-88f8-4014-a260-b4309f461d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:10.131695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bd37c-88f8-4014-a260-b4309f461d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:10.132313 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bd37c-88f8-4014-a260-b4309f461d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:10.133915 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bd37c-88f8-4014-a260-b4309f461d4d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:10.143701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1220/2446] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:18:10.147798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea86c4-a281-4d67-9b76-d49039450b05 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:10.158349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea86c4-a281-4d67-9b76-d49039450b05 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:10.162838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc233-cd9d-4a39-aca7-aad4f57aefa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:10.163478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc233-cd9d-4a39-aca7-aad4f57aefa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:10.163754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc233-cd9d-4a39-aca7-aad4f57aefa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:10.164039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc233-cd9d-4a39-aca7-aad4f57aefa8 admin admin] PATH_INFO: `/v3/projects/4b09c1d14eaa4688b088d6a70b99d371/users/3e92a823767b455195914567ae8bdc03/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:10.165981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fc233-cd9d-4a39-aca7-aad4f57aefa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b09c1d14eaa4688b088d6a70b99d371, user_id=3e92a823767b455195914567ae8bdc03, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:10.169214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fc233-cd9d-4a39-aca7-aad4f57aefa8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:10.174602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:10.180225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1227/2447] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:18:10 2022] PUT /identity/v3/projects/4b09c1d14eaa4688b088d6a70b99d371/users/3e92a823767b455195914567ae8bdc03/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:10.191390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dbb9f-08e0-400a-b7d7-e829386a6f4e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:10.191695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dbb9f-08e0-400a-b7d7-e829386a6f4e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:10.191974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dbb9f-08e0-400a-b7d7-e829386a6f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:10.219587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9d7dbb9f-08e0-400a-b7d7-e829386a6f4e None None] MFA Rules not processed for user `3e92a823767b455195914567ae8bdc03`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:10.220775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9d7dbb9f-08e0-400a-b7d7-e829386a6f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:10.296270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1221/2448] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:18:10.308857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc233-cd9d-4a39-aca7-aad4f57aefa8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:10.310602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c57fc233-cd9d-4a39-aca7-aad4f57aefa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:10.367641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc233-cd9d-4a39-aca7-aad4f57aefa8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:10.372100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f9a20-bfb0-4edc-9ffa-0931dc0c1fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:10.372743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f9a20-bfb0-4edc-9ffa-0931dc0c1fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:10.372992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f9a20-bfb0-4edc-9ffa-0931dc0c1fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:10.373826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f9a20-bfb0-4edc-9ffa-0931dc0c1fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:10.383203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f9a20-bfb0-4edc-9ffa-0931dc0c1fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:10.384574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f9a20-bfb0-4edc-9ffa-0931dc0c1fe0 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:10.394767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1228/2449] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:10.442416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dbb9f-08e0-400a-b7d7-e829386a6f4e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:10.443930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9d7dbb9f-08e0-400a-b7d7-e829386a6f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:10.450763 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:10.457611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dbb9f-08e0-400a-b7d7-e829386a6f4e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:10.461648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a20dc-8a73-4b23-82f8-6f62602c9c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:10.462414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a20dc-8a73-4b23-82f8-6f62602c9c30 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:10.462693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a20dc-8a73-4b23-82f8-6f62602c9c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:10.462962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a20dc-8a73-4b23-82f8-6f62602c9c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:10.520552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a20dc-8a73-4b23-82f8-6f62602c9c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:10.522063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a20dc-8a73-4b23-82f8-6f62602c9c30 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:10.533506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1222/2450] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:18:11.392937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f9a20-bfb0-4edc-9ffa-0931dc0c1fe0 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:11.402031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f9a20-bfb0-4edc-9ffa-0931dc0c1fe0 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:11.405689 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a7095-fa4e-452c-9f6e-fa53013a22d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:11.406290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a7095-fa4e-452c-9f6e-fa53013a22d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:11.406571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a7095-fa4e-452c-9f6e-fa53013a22d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:11.406847 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a7095-fa4e-452c-9f6e-fa53013a22d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:11.408588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1c9a7095-fa4e-452c-9f6e-fa53013a22d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:11.470611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a7095-fa4e-452c-9f6e-fa53013a22d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:11.472042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a7095-fa4e-452c-9f6e-fa53013a22d8 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:11.480982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1229/2451] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:13.832481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a20dc-8a73-4b23-82f8-6f62602c9c30 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:13.899466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a20dc-8a73-4b23-82f8-6f62602c9c30 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:13.904367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:13.905073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:13.905361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:13.905831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] PATH_INFO: `/v3/users/53ea0154cb954a11be77b7be77db2604` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:13.906980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ea0154cb954a11be77b7be77db2604)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:13.908953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:13.957450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ea0154cb954a11be77b7be77db2604'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:13.965715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ea0154cb954a11be77b7be77db2604'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:13.966698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ea0154cb954a11be77b7be77db2604'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:13.967355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ea0154cb954a11be77b7be77db2604'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:13.975203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ea0154cb954a11be77b7be77db2604'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.000128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1223/2452] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:18:13 2022] DELETE /identity/v3/users/53ea0154cb954a11be77b7be77db2604 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:14.004390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282864d5-560b-4406-bc9d-3d2316ab5944 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:14.004887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282864d5-560b-4406-bc9d-3d2316ab5944 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:14.004970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282864d5-560b-4406-bc9d-3d2316ab5944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:14.026982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-282864d5-560b-4406-bc9d-3d2316ab5944 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:14.028309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-282864d5-560b-4406-bc9d-3d2316ab5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:14.110896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1230/2453] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:14.122624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:14.124436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:14.152614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:14.206717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0676fa-7377-459e-ad43-c8773c9153e1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:14.212225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909af4c-3c49-4a77-bbe8-5300eb9a0386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:14.213009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909af4c-3c49-4a77-bbe8-5300eb9a0386 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:14.213399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909af4c-3c49-4a77-bbe8-5300eb9a0386 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:14.213957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909af4c-3c49-4a77-bbe8-5300eb9a0386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:14.227805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909af4c-3c49-4a77-bbe8-5300eb9a0386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:14.229782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909af4c-3c49-4a77-bbe8-5300eb9a0386 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:14.246694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1224/2454] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:14.605555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282864d5-560b-4406-bc9d-3d2316ab5944 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:14.607895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-282864d5-560b-4406-bc9d-3d2316ab5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:14.621401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282864d5-560b-4406-bc9d-3d2316ab5944 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:14.635323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:14.635973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:14.636252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:14.636521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] PATH_INFO: `/v3/projects/d8a70b5db7f9442580b40b6492e3ec78` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:14.640597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a70b5db7f9442580b40b6492e3ec78)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:14.642124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:14.686084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:14.697412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a70b5db7f9442580b40b6492e3ec78', 'request_id': 'req-f9bd84aa-cf85-4729-8fec-6616b95b566a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.705613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a70b5db7f9442580b40b6492e3ec78', 'request_id': 'req-f9bd84aa-cf85-4729-8fec-6616b95b566a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.713506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a70b5db7f9442580b40b6492e3ec78', 'request_id': 'req-f9bd84aa-cf85-4729-8fec-6616b95b566a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.726956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] The token cache is being invalidate because project d8a70b5db7f9442580b40b6492e3ec78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:18:14.727660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.728065 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.729653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1231/2455] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:18:14 2022] DELETE /identity/v3/projects/d8a70b5db7f9442580b40b6492e3ec78 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:14.734187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909af4c-3c49-4a77-bbe8-5300eb9a0386 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:14.743875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909af4c-3c49-4a77-bbe8-5300eb9a0386 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:14.802287 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:14.802919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:14.803198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:14.803466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] PATH_INFO: `/v3/users/3e92a823767b455195914567ae8bdc03` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:14.804577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e92a823767b455195914567ae8bdc03)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:14.806512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:14.855039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e92a823767b455195914567ae8bdc03'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.865036 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e92a823767b455195914567ae8bdc03'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.865738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e92a823767b455195914567ae8bdc03'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.866446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e92a823767b455195914567ae8bdc03'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.874576 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-730d1cc5-fb73-4328-b084-7e21bb34b245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e92a823767b455195914567ae8bdc03'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:14.895679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1225/2456] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:18:14 2022] DELETE /identity/v3/users/3e92a823767b455195914567ae8bdc03 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:15.206537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:15.208236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:15.228197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd84aa-cf85-4729-8fec-6616b95b566a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:15.291659 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:15.292289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:15.292567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:15.292840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] PATH_INFO: `/v3/projects/4b09c1d14eaa4688b088d6a70b99d371` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:15.294631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b09c1d14eaa4688b088d6a70b99d371)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:15.296515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:15.350856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b09c1d14eaa4688b088d6a70b99d371', 'request_id': 'req-08beb8b8-686e-499b-b755-0a79131b2809'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:15.357826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b09c1d14eaa4688b088d6a70b99d371', 'request_id': 'req-08beb8b8-686e-499b-b755-0a79131b2809'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:15.365721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b09c1d14eaa4688b088d6a70b99d371', 'request_id': 'req-08beb8b8-686e-499b-b755-0a79131b2809'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:15.382292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] The token cache is being invalidate because project 4b09c1d14eaa4688b088d6a70b99d371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:18:15.382512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:15.383179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08beb8b8-686e-499b-b755-0a79131b2809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:15.384652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1232/2457] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:18:15 2022] DELETE /identity/v3/projects/4b09c1d14eaa4688b088d6a70b99d371 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:15.391242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e67a-0332-491b-89e7-3d2b1dcf52e0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:15.391529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e67a-0332-491b-89e7-3d2b1dcf52e0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:15.391805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e67a-0332-491b-89e7-3d2b1dcf52e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:15.412946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3ea8e67a-0332-491b-89e7-3d2b1dcf52e0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:15.414239 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3ea8e67a-0332-491b-89e7-3d2b1dcf52e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:15.453935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:15.476884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1226/2458] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:15.485266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5715503-e309-44e3-92cc-6354ac9e19f1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:15.485565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5715503-e309-44e3-92cc-6354ac9e19f1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:15.485868 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5715503-e309-44e3-92cc-6354ac9e19f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:15.506649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e5715503-e309-44e3-92cc-6354ac9e19f1 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:15.508084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e5715503-e309-44e3-92cc-6354ac9e19f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:15.516943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1233/2459] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:15.521315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e67a-0332-491b-89e7-3d2b1dcf52e0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:15.535940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e67a-0332-491b-89e7-3d2b1dcf52e0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:15.540952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6739a7-9f0b-42a5-a004-7298b3caca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:15.541712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6739a7-9f0b-42a5-a004-7298b3caca6f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:15.542135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6739a7-9f0b-42a5-a004-7298b3caca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:15.542615 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6739a7-9f0b-42a5-a004-7298b3caca6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:15.543490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6739a7-9f0b-42a5-a004-7298b3caca6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:18:15.548023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6739a7-9f0b-42a5-a004-7298b3caca6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:15.548023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6739a7-9f0b-42a5-a004-7298b3caca6f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:15.563550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1227/2460] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:18:15.564989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5715503-e309-44e3-92cc-6354ac9e19f1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:15.574226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5715503-e309-44e3-92cc-6354ac9e19f1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:15.591827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad112d-a441-4a5e-8115-8f56279fd3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:15.592539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad112d-a441-4a5e-8115-8f56279fd3ec admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:15.592890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad112d-a441-4a5e-8115-8f56279fd3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:15.593223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad112d-a441-4a5e-8115-8f56279fd3ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:15.593971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad112d-a441-4a5e-8115-8f56279fd3ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:15.595930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad112d-a441-4a5e-8115-8f56279fd3ec admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:15.624176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1234/2461] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:18:15 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:18:15.628506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6739a7-9f0b-42a5-a004-7298b3caca6f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:15.639502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6739a7-9f0b-42a5-a004-7298b3caca6f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:15.703833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca8c93-8b0d-4114-a6e6-1333df8263d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:15.704567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca8c93-8b0d-4114-a6e6-1333df8263d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:15.704904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca8c93-8b0d-4114-a6e6-1333df8263d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:15.705236 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca8c93-8b0d-4114-a6e6-1333df8263d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:15.705978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca8c93-8b0d-4114-a6e6-1333df8263d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:15.707958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca8c93-8b0d-4114-a6e6-1333df8263d8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:15.732838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1228/2462] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:18:15 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:18:15.737354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad112d-a441-4a5e-8115-8f56279fd3ec admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:15.748296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad112d-a441-4a5e-8115-8f56279fd3ec admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:15.753112 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88c30-4be4-4abf-a98a-2bae432f4199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:15.753835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88c30-4be4-4abf-a98a-2bae432f4199 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:15.754178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88c30-4be4-4abf-a98a-2bae432f4199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:15.754515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88c30-4be4-4abf-a98a-2bae432f4199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:15.755162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a88c30-4be4-4abf-a98a-2bae432f4199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:15.756748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a88c30-4be4-4abf-a98a-2bae432f4199 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:15.767819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1235/2463] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:18:15.771819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca8c93-8b0d-4114-a6e6-1333df8263d8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:15.781932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca8c93-8b0d-4114-a6e6-1333df8263d8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:15.786666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb2afd-cc86-46dc-9ae1-0fb61164e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:15.787254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2afd-cc86-46dc-9ae1-0fb61164e2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:15.787535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2afd-cc86-46dc-9ae1-0fb61164e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:15.787808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2afd-cc86-46dc-9ae1-0fb61164e2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:15.788449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb2afd-cc86-46dc-9ae1-0fb61164e2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:15.790076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb2afd-cc86-46dc-9ae1-0fb61164e2a8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:15.802527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1229/2464] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:18:15.809777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88c30-4be4-4abf-a98a-2bae432f4199 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:15.821078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88c30-4be4-4abf-a98a-2bae432f4199 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:15.826660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c603d-fac1-481a-b294-39a079e761a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:15.827379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c603d-fac1-481a-b294-39a079e761a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:15.827673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c603d-fac1-481a-b294-39a079e761a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:15.827980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c603d-fac1-481a-b294-39a079e761a8 admin admin] PATH_INFO: `/v3/projects/2328a7d2231f4ea0a3413fecba1eadca/users/0a77abb4779b46d3a5c45cbb37097ad2/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:15.839448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:15.844357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c603d-fac1-481a-b294-39a079e761a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2328a7d2231f4ea0a3413fecba1eadca, user_id=0a77abb4779b46d3a5c45cbb37097ad2, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:15.847777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c603d-fac1-481a-b294-39a079e761a8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:15.867363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1236/2465] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:18:15 2022] PUT /identity/v3/projects/2328a7d2231f4ea0a3413fecba1eadca/users/0a77abb4779b46d3a5c45cbb37097ad2/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:15.874100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4e64-37ee-41b3-9423-624dca5e6f5c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:15.874670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4e64-37ee-41b3-9423-624dca5e6f5c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:15.874670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4e64-37ee-41b3-9423-624dca5e6f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:15.895649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8b3e4e64-37ee-41b3-9423-624dca5e6f5c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:15.896824 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8b3e4e64-37ee-41b3-9423-624dca5e6f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:15.967772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1230/2466] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:15.977773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c603d-fac1-481a-b294-39a079e761a8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:15.979625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4d6c603d-fac1-481a-b294-39a079e761a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:16.040507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c603d-fac1-481a-b294-39a079e761a8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:16.044651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04adf3-b931-4ef2-8521-2d980b6f9f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:16.045275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04adf3-b931-4ef2-8521-2d980b6f9f64 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:16.045562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04adf3-b931-4ef2-8521-2d980b6f9f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:16.045870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04adf3-b931-4ef2-8521-2d980b6f9f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:16.056316 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04adf3-b931-4ef2-8521-2d980b6f9f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:16.057781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04adf3-b931-4ef2-8521-2d980b6f9f64 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:16.068954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1237/2467] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:18:16.805734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de04e-ee29-43db-ab56-192611803ed9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:16.806271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de04e-ee29-43db-ab56-192611803ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:16.806626 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de04e-ee29-43db-ab56-192611803ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:16.838372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-225de04e-ee29-43db-ab56-192611803ed9 None None] MFA Rules not processed for user `0a77abb4779b46d3a5c45cbb37097ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:16.841110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-225de04e-ee29-43db-ab56-192611803ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:16.883736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:16.917477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1231/2468] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:16.929367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04adf3-b931-4ef2-8521-2d980b6f9f64 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:16.930999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ae04adf3-b931-4ef2-8521-2d980b6f9f64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:16.997877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04adf3-b931-4ef2-8521-2d980b6f9f64 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:17.004499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751da278-0d13-4025-bdd5-a5a71cb9b3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:17.005572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751da278-0d13-4025-bdd5-a5a71cb9b3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:17.005572 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751da278-0d13-4025-bdd5-a5a71cb9b3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:17.005780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751da278-0d13-4025-bdd5-a5a71cb9b3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:17.017908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751da278-0d13-4025-bdd5-a5a71cb9b3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:17.019531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751da278-0d13-4025-bdd5-a5a71cb9b3c5 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:17.030896 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1238/2469] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:17.359740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7d6d-c72a-460d-aded-c16c016a7ad8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:17.360105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7d6d-c72a-460d-aded-c16c016a7ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:17.360388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf7d6d-c72a-460d-aded-c16c016a7ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:17.379894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-eebf7d6d-c72a-460d-aded-c16c016a7ad8 None None] MFA Rules not processed for user `421b120ee015472bb530542ca9418589`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:17.381092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eebf7d6d-c72a-460d-aded-c16c016a7ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:17.440021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1232/2470] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:18.429245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a024b1-36ea-432e-add3-0fb9ef112d9f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:18.429756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a024b1-36ea-432e-add3-0fb9ef112d9f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:18.429938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a024b1-36ea-432e-add3-0fb9ef112d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:18.449945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c0a024b1-36ea-432e-add3-0fb9ef112d9f None None] MFA Rules not processed for user `0a77abb4779b46d3a5c45cbb37097ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:18.451493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c0a024b1-36ea-432e-add3-0fb9ef112d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:18.458468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1239/2471] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:18.710262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf7d6d-c72a-460d-aded-c16c016a7ad8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:18.722375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf7d6d-c72a-460d-aded-c16c016a7ad8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:18.728005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2a0cf-d059-439c-955b-98ce444ba5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:18.728758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2a0cf-d059-439c-955b-98ce444ba5da service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:18.729128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2a0cf-d059-439c-955b-98ce444ba5da service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:18.729466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2a0cf-d059-439c-955b-98ce444ba5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:18.732303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0da2a0cf-d059-439c-955b-98ce444ba5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:18.743869 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2a0cf-d059-439c-955b-98ce444ba5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:18.746015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2a0cf-d059-439c-955b-98ce444ba5da service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:18.756404 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1233/2472] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:28.444472 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:28.751993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=41 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:33.759505 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6c3ee-b933-4e18-9a81-83b8dccb905d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:33.759972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6c3ee-b933-4e18-9a81-83b8dccb905d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:33.760077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6c3ee-b933-4e18-9a81-83b8dccb905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:33.780117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5bc6c3ee-b933-4e18-9a81-83b8dccb905d None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:33.781337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5bc6c3ee-b933-4e18-9a81-83b8dccb905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:33.844068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1240/2473] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 19 12:18:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:33.892698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2a0cf-d059-439c-955b-98ce444ba5da service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:33.894336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0da2a0cf-d059-439c-955b-98ce444ba5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:33.966886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2a0cf-d059-439c-955b-98ce444ba5da service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:33.971946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc144a73-93d0-4465-8cd0-981290c452b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:33.972566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc144a73-93d0-4465-8cd0-981290c452b0 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:33.980323 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc144a73-93d0-4465-8cd0-981290c452b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:33.981125 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc144a73-93d0-4465-8cd0-981290c452b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:33.990318 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc144a73-93d0-4465-8cd0-981290c452b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:33.991910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc144a73-93d0-4465-8cd0-981290c452b0 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:34.001116 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1234/2474] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:18:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:18:38.531129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c763fb-4cc3-4808-a21f-58823e1a9c73 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:38.531640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c763fb-4cc3-4808-a21f-58823e1a9c73 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:38.531734 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c763fb-4cc3-4808-a21f-58823e1a9c73 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:38.533353 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1241/2475] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:18:38.548592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5e854-a9ba-4d95-8194-7f7fd11596ea None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:38.549784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5e854-a9ba-4d95-8194-7f7fd11596ea None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:38.550265 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5e854-a9ba-4d95-8194-7f7fd11596ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:38.573569 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c8b5e854-a9ba-4d95-8194-7f7fd11596ea None None] MFA Rules not processed for user `1aded088aa2a40e4b7fe024647ebfbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:38.574807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c8b5e854-a9ba-4d95-8194-7f7fd11596ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:38.643884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1235/2476] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:18:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:38.683958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c763fb-4cc3-4808-a21f-58823e1a9c73 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:38.685942 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c3c763fb-4cc3-4808-a21f-58823e1a9c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:38.707406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c763fb-4cc3-4808-a21f-58823e1a9c73 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:38.712902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d22b6-5391-46fb-a2f9-f05a356bdef0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:38.713537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d22b6-5391-46fb-a2f9-f05a356bdef0 service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:38.713907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d22b6-5391-46fb-a2f9-f05a356bdef0 service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:38.714205 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d22b6-5391-46fb-a2f9-f05a356bdef0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:38.728754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d22b6-5391-46fb-a2f9-f05a356bdef0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:38.730448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d22b6-5391-46fb-a2f9-f05a356bdef0 service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:38.742786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1242/2477] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:40.494977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b30a1-16d6-4a97-8204-9aa50a276524 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:40.495502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b30a1-16d6-4a97-8204-9aa50a276524 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:40.495502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b30a1-16d6-4a97-8204-9aa50a276524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:40.516146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3b7b30a1-16d6-4a97-8204-9aa50a276524 None None] MFA Rules not processed for user `0a77abb4779b46d3a5c45cbb37097ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:18:40.517458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3b7b30a1-16d6-4a97-8204-9aa50a276524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:40.524942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1236/2478] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:18:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:18:41.890158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d22b6-5391-46fb-a2f9-f05a356bdef0 service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:41.892326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f67d22b6-5391-46fb-a2f9-f05a356bdef0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:41.908152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d22b6-5391-46fb-a2f9-f05a356bdef0 service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:41.916374 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83b7a6-4df2-4f50-a7e5-ca33473d1cf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:41.917226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83b7a6-4df2-4f50-a7e5-ca33473d1cf5 service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:41.917746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83b7a6-4df2-4f50-a7e5-ca33473d1cf5 service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:41.918224 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83b7a6-4df2-4f50-a7e5-ca33473d1cf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:41.921725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6d83b7a6-4df2-4f50-a7e5-ca33473d1cf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:41.938236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83b7a6-4df2-4f50-a7e5-ca33473d1cf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:41.940167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83b7a6-4df2-4f50-a7e5-ca33473d1cf5 service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:41.954711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b30a1-16d6-4a97-8204-9aa50a276524 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:41.956301 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3b7b30a1-16d6-4a97-8204-9aa50a276524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:41.957681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1243/2479] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:18:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:18:41.985049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b30a1-16d6-4a97-8204-9aa50a276524 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:41.990020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:41.990662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:41.990941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:41.991218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] PATH_INFO: `/v3/users/f350a091096742519e5a925ecf3b8ee0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:41.992617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f350a091096742519e5a925ecf3b8ee0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:41.995468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:42.079688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f350a091096742519e5a925ecf3b8ee0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.087317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f350a091096742519e5a925ecf3b8ee0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.087930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f350a091096742519e5a925ecf3b8ee0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.088539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f350a091096742519e5a925ecf3b8ee0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.097319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f350a091096742519e5a925ecf3b8ee0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.111080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:42.122821 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1237/2480] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:18:41 2022] DELETE /identity/v3/users/f350a091096742519e5a925ecf3b8ee0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:42.303179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83b7a6-4df2-4f50-a7e5-ca33473d1cf5 service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:42.321362 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83b7a6-4df2-4f50-a7e5-ca33473d1cf5 service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:42.382728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:42.383399 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:42.383694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:42.383989 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] PATH_INFO: `/v3/projects/bd60470c140247afb90345ab6f6715a4` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:42.385282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd60470c140247afb90345ab6f6715a4)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:42.387498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:42.435888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd60470c140247afb90345ab6f6715a4', 'request_id': 'req-f18ba6a7-a0ec-4420-9aea-447c96864928'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.441354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd60470c140247afb90345ab6f6715a4', 'request_id': 'req-f18ba6a7-a0ec-4420-9aea-447c96864928'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.451052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd60470c140247afb90345ab6f6715a4', 'request_id': 'req-f18ba6a7-a0ec-4420-9aea-447c96864928'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.464024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] The token cache is being invalidate because project bd60470c140247afb90345ab6f6715a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:18:42.464570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.465539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.468067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1244/2481] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:18:42 2022] DELETE /identity/v3/projects/bd60470c140247afb90345ab6f6715a4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:42.471928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:42.473424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:42.490489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6be4c-8c53-4012-990c-c3fac4695f9a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:42.560711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:42.561381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:42.561680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:42.561950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] PATH_INFO: `/v3/users/24a9cda96ca947cb92e391ddcbddfc6a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:42.563807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a9cda96ca947cb92e391ddcbddfc6a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:42.565747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:42.628567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a9cda96ca947cb92e391ddcbddfc6a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.636379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a9cda96ca947cb92e391ddcbddfc6a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.637001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a9cda96ca947cb92e391ddcbddfc6a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.637810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a9cda96ca947cb92e391ddcbddfc6a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.645180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fbac141f-5e88-4fcf-a34f-7313a2213b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a9cda96ca947cb92e391ddcbddfc6a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:42.663097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1238/2482] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:18:42 2022] DELETE /identity/v3/users/24a9cda96ca947cb92e391ddcbddfc6a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:42.970655 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:18:42.972204 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:18:42.987348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ba6a7-a0ec-4420-9aea-447c96864928 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:18:42.992432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:43.052725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:18:43.053359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:43.053658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:43.053934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] PATH_INFO: `/v3/projects/d51c95a3122a4db0acb90a502cf7e557` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:43.055058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51c95a3122a4db0acb90a502cf7e557)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:18:43.056953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:18:43.105330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51c95a3122a4db0acb90a502cf7e557', 'request_id': 'req-389afb54-a9d3-45ee-8be1-9c2bfdfed238'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:43.111842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51c95a3122a4db0acb90a502cf7e557', 'request_id': 'req-389afb54-a9d3-45ee-8be1-9c2bfdfed238'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:43.121423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51c95a3122a4db0acb90a502cf7e557', 'request_id': 'req-389afb54-a9d3-45ee-8be1-9c2bfdfed238'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:43.135032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] The token cache is being invalidate because project d51c95a3122a4db0acb90a502cf7e557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:18:43.135334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:43.136142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:18:43.137688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1245/2483] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:18:42 2022] DELETE /identity/v3/projects/d51c95a3122a4db0acb90a502cf7e557 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:18:52.664702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=56,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:53.130831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:59.976972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f035e3-82c2-43b3-ac99-e234a2756d4f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:18:59.977421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f035e3-82c2-43b3-ac99-e234a2756d4f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:18:59.977853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f035e3-82c2-43b3-ac99-e234a2756d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:18:59.999700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-34f035e3-82c2-43b3-ac99-e234a2756d4f None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:00.000161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-34f035e3-82c2-43b3-ac99-e234a2756d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:00.061393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1239/2484] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:18:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:00.074095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:00.075865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:00.154338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389afb54-a9d3-45ee-8be1-9c2bfdfed238 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:00.160849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acbf33-1623-4d18-a2f4-a3804fb7b4a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:00.161546 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acbf33-1623-4d18-a2f4-a3804fb7b4a9 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:00.161929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acbf33-1623-4d18-a2f4-a3804fb7b4a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:00.163668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acbf33-1623-4d18-a2f4-a3804fb7b4a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:00.173012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acbf33-1623-4d18-a2f4-a3804fb7b4a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:00.174829 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acbf33-1623-4d18-a2f4-a3804fb7b4a9 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:00.183843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1246/2485] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:19:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:19:10.054761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=25 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:10.180773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=32 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:15.639660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19eb50-4a29-4b5c-b7f7-bb63cbd00878 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:15.640166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19eb50-4a29-4b5c-b7f7-bb63cbd00878 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:15.640274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19eb50-4a29-4b5c-b7f7-bb63cbd00878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:15.659962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bb19eb50-4a29-4b5c-b7f7-bb63cbd00878 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:15.661209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bb19eb50-4a29-4b5c-b7f7-bb63cbd00878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:15.669731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1240/2486] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 19 12:19:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:15.682593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acbf33-1623-4d18-a2f4-a3804fb7b4a9 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:15.693639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acbf33-1623-4d18-a2f4-a3804fb7b4a9 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:15.698588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582a6db-0e4e-420c-901a-4b982cd50221 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:15.699174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582a6db-0e4e-420c-901a-4b982cd50221 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:15.699453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582a6db-0e4e-420c-901a-4b982cd50221 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:15.699726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582a6db-0e4e-420c-901a-4b982cd50221 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:15.707945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582a6db-0e4e-420c-901a-4b982cd50221 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:15.709511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582a6db-0e4e-420c-901a-4b982cd50221 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:15.718157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1247/2487] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:19:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:19:17.624031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19eb50-4a29-4b5c-b7f7-bb63cbd00878 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:17.626167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bb19eb50-4a29-4b5c-b7f7-bb63cbd00878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:17.697196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19eb50-4a29-4b5c-b7f7-bb63cbd00878 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:17.701868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:17.705727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:17.705727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:17.705727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] PATH_INFO: `/v3/users/0a77abb4779b46d3a5c45cbb37097ad2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:17.706919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a77abb4779b46d3a5c45cbb37097ad2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:17.708879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:17.762614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a77abb4779b46d3a5c45cbb37097ad2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:17.771507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a77abb4779b46d3a5c45cbb37097ad2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:17.772160 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a77abb4779b46d3a5c45cbb37097ad2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:17.772770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a77abb4779b46d3a5c45cbb37097ad2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:17.781320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc350a52-06a1-4396-8107-7197f97a00f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a77abb4779b46d3a5c45cbb37097ad2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:17.801235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1241/2488] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:19:17 2022] DELETE /identity/v3/users/0a77abb4779b46d3a5c45cbb37097ad2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:19:17.977840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582a6db-0e4e-420c-901a-4b982cd50221 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:17.988953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582a6db-0e4e-420c-901a-4b982cd50221 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:18.051524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:18.052153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.052435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.052715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] PATH_INFO: `/v3/projects/2328a7d2231f4ea0a3413fecba1eadca` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.053874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2328a7d2231f4ea0a3413fecba1eadca)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:18.055771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:18.103143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2328a7d2231f4ea0a3413fecba1eadca', 'request_id': 'req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:18.109206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2328a7d2231f4ea0a3413fecba1eadca', 'request_id': 'req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:18.116287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2328a7d2231f4ea0a3413fecba1eadca', 'request_id': 'req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:18.127957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] The token cache is being invalidate because project 2328a7d2231f4ea0a3413fecba1eadca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:19:18.128244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:18.128861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-688dd9e8-532b-4c97-ace0-e5ee7ef4d742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:18.130360 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1248/2489] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:19:17 2022] DELETE /identity/v3/projects/2328a7d2231f4ea0a3413fecba1eadca => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:19:18.136522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b998d-d381-4618-bf6d-cdda7d814700 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.136906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b998d-d381-4618-bf6d-cdda7d814700 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.137328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b998d-d381-4618-bf6d-cdda7d814700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.157782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b73b998d-d381-4618-bf6d-cdda7d814700 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:18.158969 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b73b998d-d381-4618-bf6d-cdda7d814700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:18.215514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1242/2490] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:18.223005 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698bb76-1d6a-4750-adf3-86cb3fe261c2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.223288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698bb76-1d6a-4750-adf3-86cb3fe261c2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.223562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698bb76-1d6a-4750-adf3-86cb3fe261c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.243049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e698bb76-1d6a-4750-adf3-86cb3fe261c2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:18.244229 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e698bb76-1d6a-4750-adf3-86cb3fe261c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:18.252482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1249/2491] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:18.256592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b998d-d381-4618-bf6d-cdda7d814700 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:18.267178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b998d-d381-4618-bf6d-cdda7d814700 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:18.271631 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5b892-c8d5-4c88-8aee-c9bd2348569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:18.272219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5b892-c8d5-4c88-8aee-c9bd2348569d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.272496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5b892-c8d5-4c88-8aee-c9bd2348569d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.272768 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5b892-c8d5-4c88-8aee-c9bd2348569d admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.273399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5b892-c8d5-4c88-8aee-c9bd2348569d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:19:18.273740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5b892-c8d5-4c88-8aee-c9bd2348569d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:18.275298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5b892-c8d5-4c88-8aee-c9bd2348569d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:18.284023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:18.287530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1243/2492] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:19:18.291654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698bb76-1d6a-4750-adf3-86cb3fe261c2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:18.301401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698bb76-1d6a-4750-adf3-86cb3fe261c2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:18.306187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b852951-1122-451a-a50a-ce4753b25eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:18.306785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b852951-1122-451a-a50a-ce4753b25eed admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.307061 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b852951-1122-451a-a50a-ce4753b25eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.307330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b852951-1122-451a-a50a-ce4753b25eed admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.307964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b852951-1122-451a-a50a-ce4753b25eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:18.309870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b852951-1122-451a-a50a-ce4753b25eed admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:18.338318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1250/2493] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:19:18 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:19:18.342388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5b892-c8d5-4c88-8aee-c9bd2348569d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:18.352367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5b892-c8d5-4c88-8aee-c9bd2348569d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:18.407450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4feeb8-7bcd-405f-9990-c24d57fc0531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:18.408058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4feeb8-7bcd-405f-9990-c24d57fc0531 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.408336 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4feeb8-7bcd-405f-9990-c24d57fc0531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.408609 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4feeb8-7bcd-405f-9990-c24d57fc0531 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.409242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4feeb8-7bcd-405f-9990-c24d57fc0531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:18.411167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4feeb8-7bcd-405f-9990-c24d57fc0531 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:18.432033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1244/2494] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:19:18 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:19:18.436141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b852951-1122-451a-a50a-ce4753b25eed admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:18.447410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b852951-1122-451a-a50a-ce4753b25eed admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:18.452176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8c75e-3b82-4401-b2a6-50e9f382629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:18.452831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8c75e-3b82-4401-b2a6-50e9f382629e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.453117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8c75e-3b82-4401-b2a6-50e9f382629e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.453392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8c75e-3b82-4401-b2a6-50e9f382629e admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.454107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8c75e-3b82-4401-b2a6-50e9f382629e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:18.455728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8c75e-3b82-4401-b2a6-50e9f382629e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:18.465667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1251/2495] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:19:18.469899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4feeb8-7bcd-405f-9990-c24d57fc0531 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:18.479603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4feeb8-7bcd-405f-9990-c24d57fc0531 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:18.484936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4a6a4-9491-4929-b2ed-9d3d97bb19c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:18.485533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4a6a4-9491-4929-b2ed-9d3d97bb19c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.485918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4a6a4-9491-4929-b2ed-9d3d97bb19c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.486228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4a6a4-9491-4929-b2ed-9d3d97bb19c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.486869 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4a6a4-9491-4929-b2ed-9d3d97bb19c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:18.488458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4a6a4-9491-4929-b2ed-9d3d97bb19c6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:18.499192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1245/2496] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:19:18.503530 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8c75e-3b82-4401-b2a6-50e9f382629e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:18.513513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8c75e-3b82-4401-b2a6-50e9f382629e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:18.518607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1647-5e24-4909-a28f-711735003f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:18.519244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1647-5e24-4909-a28f-711735003f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.519525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1647-5e24-4909-a28f-711735003f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.519803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1647-5e24-4909-a28f-711735003f6d admin admin] PATH_INFO: `/v3/projects/d5e2f0a1df084043988f28e2ec61eed6/users/b732e9a9b20b4819a4e946c20d4e879b/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.539431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace1647-5e24-4909-a28f-711735003f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e2f0a1df084043988f28e2ec61eed6, user_id=b732e9a9b20b4819a4e946c20d4e879b, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:18.542133 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace1647-5e24-4909-a28f-711735003f6d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:18.555460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1252/2497] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:19:18 2022] PUT /identity/v3/projects/d5e2f0a1df084043988f28e2ec61eed6/users/b732e9a9b20b4819a4e946c20d4e879b/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:19:18.566214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7fb9c-945b-46e8-9da5-7f9ae25e95ad None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.566507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7fb9c-945b-46e8-9da5-7f9ae25e95ad None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.566792 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7fb9c-945b-46e8-9da5-7f9ae25e95ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.595159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-31d7fb9c-945b-46e8-9da5-7f9ae25e95ad None None] MFA Rules not processed for user `b732e9a9b20b4819a4e946c20d4e879b`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:18.596376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-31d7fb9c-945b-46e8-9da5-7f9ae25e95ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:18.664901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1246/2498] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:18.676837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1647-5e24-4909-a28f-711735003f6d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:18.678312 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ace1647-5e24-4909-a28f-711735003f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:18.694013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:18.741765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1647-5e24-4909-a28f-711735003f6d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:18.745332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebb09d-0e0d-4fd6-8cd3-1e36a62730a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:18.745956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb09d-0e0d-4fd6-8cd3-1e36a62730a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:18.746235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb09d-0e0d-4fd6-8cd3-1e36a62730a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:18.746506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb09d-0e0d-4fd6-8cd3-1e36a62730a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:18.755963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebb09d-0e0d-4fd6-8cd3-1e36a62730a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:18.757435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebb09d-0e0d-4fd6-8cd3-1e36a62730a5 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:18.767484 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1253/2499] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:19:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:22.378477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7fb9c-945b-46e8-9da5-7f9ae25e95ad None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:22.439589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7fb9c-945b-46e8-9da5-7f9ae25e95ad None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:22.443976 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:22.444578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:22.444852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:22.445121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] PATH_INFO: `/v3/users/b732e9a9b20b4819a4e946c20d4e879b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:22.446664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b732e9a9b20b4819a4e946c20d4e879b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:22.448781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:22.460008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:22.495955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b732e9a9b20b4819a4e946c20d4e879b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:22.503634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b732e9a9b20b4819a4e946c20d4e879b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:22.504376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b732e9a9b20b4819a4e946c20d4e879b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:22.504973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b732e9a9b20b4819a4e946c20d4e879b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:22.511741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b732e9a9b20b4819a4e946c20d4e879b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:22.528866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1247/2500] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:19:22 2022] DELETE /identity/v3/users/b732e9a9b20b4819a4e946c20d4e879b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:19:22.533431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7fe26-b6a1-443b-8a7e-9ebf042a9536 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:22.533929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7fe26-b6a1-443b-8a7e-9ebf042a9536 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:22.534037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7fe26-b6a1-443b-8a7e-9ebf042a9536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:22.552476 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3af7fe26-b6a1-443b-8a7e-9ebf042a9536 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:22.553702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3af7fe26-b6a1-443b-8a7e-9ebf042a9536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:22.613125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1254/2501] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:22.622842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:22.624235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:22.683112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d66ae-3bbf-49c4-817c-ba5f2331bd1f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:22.686744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59902e71-c222-47fd-a588-a30dd65cb23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:22.687341 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59902e71-c222-47fd-a588-a30dd65cb23b service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:22.688235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59902e71-c222-47fd-a588-a30dd65cb23b service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:22.688504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59902e71-c222-47fd-a588-a30dd65cb23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:22.697575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59902e71-c222-47fd-a588-a30dd65cb23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:22.699008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59902e71-c222-47fd-a588-a30dd65cb23b service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:22.708746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1248/2502] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:22.971526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7fe26-b6a1-443b-8a7e-9ebf042a9536 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:22.972983 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3af7fe26-b6a1-443b-8a7e-9ebf042a9536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:22.989140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7fe26-b6a1-443b-8a7e-9ebf042a9536 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:22.993820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:22.994450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:22.994721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:22.994992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] PATH_INFO: `/v3/projects/d5e2f0a1df084043988f28e2ec61eed6` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:22.996095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e2f0a1df084043988f28e2ec61eed6)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:22.998030 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:23.044510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e2f0a1df084043988f28e2ec61eed6', 'request_id': 'req-248b4343-5932-4128-a326-d4f95b9f4bc8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:23.050479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e2f0a1df084043988f28e2ec61eed6', 'request_id': 'req-248b4343-5932-4128-a326-d4f95b9f4bc8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:23.057504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e2f0a1df084043988f28e2ec61eed6', 'request_id': 'req-248b4343-5932-4128-a326-d4f95b9f4bc8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:23.068825 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] The token cache is being invalidate because project d5e2f0a1df084043988f28e2ec61eed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:19:23.069109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:23.069745 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-248b4343-5932-4128-a326-d4f95b9f4bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:23.071203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1255/2503] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:19:22 2022] DELETE /identity/v3/projects/d5e2f0a1df084043988f28e2ec61eed6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:19:23.075953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaadca9-3209-45b3-8f92-606d844b262b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.076238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaadca9-3209-45b3-8f92-606d844b262b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.076513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaadca9-3209-45b3-8f92-606d844b262b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.095796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bfaadca9-3209-45b3-8f92-606d844b262b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:23.096985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bfaadca9-3209-45b3-8f92-606d844b262b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:23.157361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1249/2504] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:23.166504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e286e0-d6d5-44da-8bd0-b5c01c6c5ea0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.166791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e286e0-d6d5-44da-8bd0-b5c01c6c5ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.167067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e286e0-d6d5-44da-8bd0-b5c01c6c5ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.187307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-99e286e0-d6d5-44da-8bd0-b5c01c6c5ea0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:23.189086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-99e286e0-d6d5-44da-8bd0-b5c01c6c5ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:23.197965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1256/2505] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:19:23.202321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaadca9-3209-45b3-8f92-606d844b262b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:23.213228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaadca9-3209-45b3-8f92-606d844b262b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:23.217829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f781b6-ef86-44e3-97e8-00667da322f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:23.218430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f781b6-ef86-44e3-97e8-00667da322f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.218749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f781b6-ef86-44e3-97e8-00667da322f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.219053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f781b6-ef86-44e3-97e8-00667da322f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.219708 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f781b6-ef86-44e3-97e8-00667da322f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:19:23.220011 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f781b6-ef86-44e3-97e8-00667da322f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:23.221764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f781b6-ef86-44e3-97e8-00667da322f2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:23.233308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1250/2506] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:19:23.238068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e286e0-d6d5-44da-8bd0-b5c01c6c5ea0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:23.247382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e286e0-d6d5-44da-8bd0-b5c01c6c5ea0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:23.252694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7dc7-aa0b-40b2-8835-7d18f7f6dd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:23.253270 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7dc7-aa0b-40b2-8835-7d18f7f6dd32 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.253551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7dc7-aa0b-40b2-8835-7d18f7f6dd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.253853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7dc7-aa0b-40b2-8835-7d18f7f6dd32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.254479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7dc7-aa0b-40b2-8835-7d18f7f6dd32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:23.256394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7dc7-aa0b-40b2-8835-7d18f7f6dd32 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:23.284837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1257/2507] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:19:23 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:19:23.288819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f781b6-ef86-44e3-97e8-00667da322f2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:23.298877 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f781b6-ef86-44e3-97e8-00667da322f2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:23.311330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:23.358775 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65c24d-bae1-4aef-b2c7-14857db0dc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:23.359867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65c24d-bae1-4aef-b2c7-14857db0dc2b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.360230 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65c24d-bae1-4aef-b2c7-14857db0dc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.360507 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65c24d-bae1-4aef-b2c7-14857db0dc2b admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.361144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65c24d-bae1-4aef-b2c7-14857db0dc2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:23.363075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65c24d-bae1-4aef-b2c7-14857db0dc2b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:23.388443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1251/2508] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:19:23 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:19:23.390216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7dc7-aa0b-40b2-8835-7d18f7f6dd32 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:23.401218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7dc7-aa0b-40b2-8835-7d18f7f6dd32 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:23.405904 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f95d-1542-4e14-bfcd-186ebea3ad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:23.406594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f95d-1542-4e14-bfcd-186ebea3ad8f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.406908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f95d-1542-4e14-bfcd-186ebea3ad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.407183 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f95d-1542-4e14-bfcd-186ebea3ad8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.407850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337f95d-1542-4e14-bfcd-186ebea3ad8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:23.409435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337f95d-1542-4e14-bfcd-186ebea3ad8f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:23.414805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:23.420099 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1258/2509] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:19:23.424274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65c24d-bae1-4aef-b2c7-14857db0dc2b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:23.434650 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65c24d-bae1-4aef-b2c7-14857db0dc2b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:23.440267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08287908-dc71-4ab7-b2a1-ab335cf0e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:23.440878 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08287908-dc71-4ab7-b2a1-ab335cf0e09b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.441163 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08287908-dc71-4ab7-b2a1-ab335cf0e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.441444 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08287908-dc71-4ab7-b2a1-ab335cf0e09b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.442123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08287908-dc71-4ab7-b2a1-ab335cf0e09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:23.443717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08287908-dc71-4ab7-b2a1-ab335cf0e09b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:23.457349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1252/2510] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:19:23.461576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f95d-1542-4e14-bfcd-186ebea3ad8f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:23.472054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f95d-1542-4e14-bfcd-186ebea3ad8f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:23.477043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed30d2-f899-4e74-a828-57ccaf5e12dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:23.477835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed30d2-f899-4e74-a828-57ccaf5e12dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.478036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed30d2-f899-4e74-a828-57ccaf5e12dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.478309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed30d2-f899-4e74-a828-57ccaf5e12dd admin admin] PATH_INFO: `/v3/projects/6adce913fd5d4aacb1b30106323224e5/users/9e71512662184b7eabe9763f0e4faecd/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.494553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed30d2-f899-4e74-a828-57ccaf5e12dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6adce913fd5d4aacb1b30106323224e5, user_id=9e71512662184b7eabe9763f0e4faecd, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:23.497190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed30d2-f899-4e74-a828-57ccaf5e12dd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:23.512756 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1259/2511] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:19:23 2022] PUT /identity/v3/projects/6adce913fd5d4aacb1b30106323224e5/users/9e71512662184b7eabe9763f0e4faecd/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:19:23.523370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76446e2-46bb-4047-b4af-48513b443f33 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.523663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76446e2-46bb-4047-b4af-48513b443f33 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.523943 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76446e2-46bb-4047-b4af-48513b443f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.552776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d76446e2-46bb-4047-b4af-48513b443f33 None None] MFA Rules not processed for user `9e71512662184b7eabe9763f0e4faecd`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:23.554019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d76446e2-46bb-4047-b4af-48513b443f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:23.621426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1253/2512] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:23.633049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed30d2-f899-4e74-a828-57ccaf5e12dd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:23.634957 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a7ed30d2-f899-4e74-a828-57ccaf5e12dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:23.693291 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed30d2-f899-4e74-a828-57ccaf5e12dd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:23.697032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d346d9-7367-4cd9-8444-e3fe906af5ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:23.697671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d346d9-7367-4cd9-8444-e3fe906af5ab service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.697964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d346d9-7367-4cd9-8444-e3fe906af5ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.698241 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d346d9-7367-4cd9-8444-e3fe906af5ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.707680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d346d9-7367-4cd9-8444-e3fe906af5ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:23.709102 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d346d9-7367-4cd9-8444-e3fe906af5ab service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:23.718202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1260/2513] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:19:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:23.743794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76446e2-46bb-4047-b4af-48513b443f33 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:23.807649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76446e2-46bb-4047-b4af-48513b443f33 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:23.812740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:23.813700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.814007 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.814283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] PATH_INFO: `/v3/users/9e71512662184b7eabe9763f0e4faecd` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.815443 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e71512662184b7eabe9763f0e4faecd)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:23.817407 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:23.850020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:23.871746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e71512662184b7eabe9763f0e4faecd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:23.880854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e71512662184b7eabe9763f0e4faecd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:23.881495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e71512662184b7eabe9763f0e4faecd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:23.882277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e71512662184b7eabe9763f0e4faecd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:23.885677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab232-fcbf-4d9a-9f50-443f29b11048 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.885971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab232-fcbf-4d9a-9f50-443f29b11048 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.886254 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab232-fcbf-4d9a-9f50-443f29b11048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.890139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d863252c-713a-4b1f-a02e-bd19d015604f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e71512662184b7eabe9763f0e4faecd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:23.906231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-444ab232-fcbf-4d9a-9f50-443f29b11048 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:23.907783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-444ab232-fcbf-4d9a-9f50-443f29b11048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:23.908256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1254/2514] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:19:23 2022] DELETE /identity/v3/users/9e71512662184b7eabe9763f0e4faecd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:19:23.912582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1296b-8333-4d8f-9ef7-53f60a9711be None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:23.912866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1296b-8333-4d8f-9ef7-53f60a9711be None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:23.913138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1296b-8333-4d8f-9ef7-53f60a9711be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:23.931980 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dfd1296b-8333-4d8f-9ef7-53f60a9711be None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:23.933166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dfd1296b-8333-4d8f-9ef7-53f60a9711be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:23.970042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1261/2515] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:19:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:19:23.983329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ab232-fcbf-4d9a-9f50-443f29b11048 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:23.985854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-444ab232-fcbf-4d9a-9f50-443f29b11048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:23.996596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1255/2516] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:19:24.007044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1296b-8333-4d8f-9ef7-53f60a9711be None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:24.008449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dfd1296b-8333-4d8f-9ef7-53f60a9711be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:24.059807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ab232-fcbf-4d9a-9f50-443f29b11048 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:24.065017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aee43f-2291-46e3-b9e7-ce6577cf7d0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:24.065161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1296b-8333-4d8f-9ef7-53f60a9711be None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:24.065629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aee43f-2291-46e3-b9e7-ce6577cf7d0f service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:24.065937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aee43f-2291-46e3-b9e7-ce6577cf7d0f service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:24.066215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aee43f-2291-46e3-b9e7-ce6577cf7d0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:24.068755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f8899-b527-4920-89d1-723f2492d1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:24.069355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f8899-b527-4920-89d1-723f2492d1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:24.069645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f8899-b527-4920-89d1-723f2492d1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:24.069922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f8899-b527-4920-89d1-723f2492d1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:24.074320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aee43f-2291-46e3-b9e7-ce6577cf7d0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:24.075852 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aee43f-2291-46e3-b9e7-ce6577cf7d0f service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:24.078831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f8899-b527-4920-89d1-723f2492d1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:24.080241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f8899-b527-4920-89d1-723f2492d1d7 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:24.084305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1262/2517] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:19:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 12:19:24.090292 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1256/2518] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:19:24.393425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aee43f-2291-46e3-b9e7-ce6577cf7d0f service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:24.394924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-64aee43f-2291-46e3-b9e7-ce6577cf7d0f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:24.423960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aee43f-2291-46e3-b9e7-ce6577cf7d0f service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:24.430591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:24.431412 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:24.431860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:24.432137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] PATH_INFO: `/v3/projects/6adce913fd5d4aacb1b30106323224e5` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:24.433298 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=6adce913fd5d4aacb1b30106323224e5)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:24.435239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:24.446161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:24.495666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6adce913fd5d4aacb1b30106323224e5', 'request_id': 'req-915372ac-e039-4e0a-b9af-829ef12a42ad'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:24.502849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6adce913fd5d4aacb1b30106323224e5', 'request_id': 'req-915372ac-e039-4e0a-b9af-829ef12a42ad'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:24.512417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6adce913fd5d4aacb1b30106323224e5', 'request_id': 'req-915372ac-e039-4e0a-b9af-829ef12a42ad'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:24.526570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] The token cache is being invalidate because project 6adce913fd5d4aacb1b30106323224e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:19:24.526851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:24.527504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-915372ac-e039-4e0a-b9af-829ef12a42ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:24.529524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1263/2519] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:19:24 2022] DELETE /identity/v3/projects/6adce913fd5d4aacb1b30106323224e5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:19:24.535035 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17f98-7164-4945-9ce4-c56e686bc612 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:24.535519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17f98-7164-4945-9ce4-c56e686bc612 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:24.535625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17f98-7164-4945-9ce4-c56e686bc612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:24.570168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d7a17f98-7164-4945-9ce4-c56e686bc612 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:24.571434 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d7a17f98-7164-4945-9ce4-c56e686bc612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:24.635840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:24.658989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1257/2520] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:24.668022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad38fe-890c-46ff-b850-39244c25a6a2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:24.668567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad38fe-890c-46ff-b850-39244c25a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:24.668567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad38fe-890c-46ff-b850-39244c25a6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:24.694065 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c3ad38fe-890c-46ff-b850-39244c25a6a2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:24.696386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c3ad38fe-890c-46ff-b850-39244c25a6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:24.714768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1264/2521] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:24.715979 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a17f98-7164-4945-9ce4-c56e686bc612 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:24.728173 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a17f98-7164-4945-9ce4-c56e686bc612 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:24.733204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43b827-9703-47f2-a86a-3436cbbc41a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:24.734227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b827-9703-47f2-a86a-3436cbbc41a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:24.735279 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b827-9703-47f2-a86a-3436cbbc41a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:24.735646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b827-9703-47f2-a86a-3436cbbc41a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:24.736509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43b827-9703-47f2-a86a-3436cbbc41a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:19:24.736915 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43b827-9703-47f2-a86a-3436cbbc41a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:24.738638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43b827-9703-47f2-a86a-3436cbbc41a9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:24.757901 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1258/2522] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:19:24.759068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad38fe-890c-46ff-b850-39244c25a6a2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:24.771169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad38fe-890c-46ff-b850-39244c25a6a2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:24.775993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c469fb0-fe38-4c85-9da6-bbd5dec51060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:24.776741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c469fb0-fe38-4c85-9da6-bbd5dec51060 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:24.777033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c469fb0-fe38-4c85-9da6-bbd5dec51060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:24.777311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c469fb0-fe38-4c85-9da6-bbd5dec51060 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:24.777979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c469fb0-fe38-4c85-9da6-bbd5dec51060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:24.779951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c469fb0-fe38-4c85-9da6-bbd5dec51060 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:24.817929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1265/2523] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:19:24 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:19:24.818757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43b827-9703-47f2-a86a-3436cbbc41a9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:24.829093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43b827-9703-47f2-a86a-3436cbbc41a9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:24.892353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633613-0447-4d38-b2da-8cf9c608db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:24.892883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633613-0447-4d38-b2da-8cf9c608db94 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:24.893309 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633613-0447-4d38-b2da-8cf9c608db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:24.893588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633613-0447-4d38-b2da-8cf9c608db94 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:24.894253 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c633613-0447-4d38-b2da-8cf9c608db94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:24.896147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c633613-0447-4d38-b2da-8cf9c608db94 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:24.923190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1259/2524] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:19:24 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:19:24.924550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c469fb0-fe38-4c85-9da6-bbd5dec51060 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:24.940194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c469fb0-fe38-4c85-9da6-bbd5dec51060 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:24.946025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107de2c-cc2a-471e-b558-f50658ed86c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:24.946791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107de2c-cc2a-471e-b558-f50658ed86c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:24.947076 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107de2c-cc2a-471e-b558-f50658ed86c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:24.947404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107de2c-cc2a-471e-b558-f50658ed86c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:24.948146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107de2c-cc2a-471e-b558-f50658ed86c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:24.949955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107de2c-cc2a-471e-b558-f50658ed86c4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:24.964550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1266/2525] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:19:24.966120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633613-0447-4d38-b2da-8cf9c608db94 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:24.977440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633613-0447-4d38-b2da-8cf9c608db94 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:24.982602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19381eb1-a88c-4f6e-a503-0ea85c71794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:24.983332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19381eb1-a88c-4f6e-a503-0ea85c71794b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:24.983711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19381eb1-a88c-4f6e-a503-0ea85c71794b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:24.985018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19381eb1-a88c-4f6e-a503-0ea85c71794b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:24.987987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19381eb1-a88c-4f6e-a503-0ea85c71794b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:24.989857 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19381eb1-a88c-4f6e-a503-0ea85c71794b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:25.002169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1260/2526] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:19:25.006474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107de2c-cc2a-471e-b558-f50658ed86c4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:25.018020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107de2c-cc2a-471e-b558-f50658ed86c4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:25.022961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a2e15-5aa9-4e69-9d1d-ecaba16d740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:25.023647 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2e15-5aa9-4e69-9d1d-ecaba16d740b admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:25.023925 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2e15-5aa9-4e69-9d1d-ecaba16d740b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:25.024201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2e15-5aa9-4e69-9d1d-ecaba16d740b admin admin] PATH_INFO: `/v3/projects/01e2ab7186e64a7595a8e0995aa3732a/users/d344ee3c6b914c24a6f319147004dcf8/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:25.043975 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a2e15-5aa9-4e69-9d1d-ecaba16d740b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e2ab7186e64a7595a8e0995aa3732a, user_id=d344ee3c6b914c24a6f319147004dcf8, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:25.047481 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a2e15-5aa9-4e69-9d1d-ecaba16d740b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:25.063533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1267/2527] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:19:25 2022] PUT /identity/v3/projects/01e2ab7186e64a7595a8e0995aa3732a/users/d344ee3c6b914c24a6f319147004dcf8/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:19:25.130020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac35397-4832-4028-b94f-57ba13c86614 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:25.130294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac35397-4832-4028-b94f-57ba13c86614 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:25.130568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac35397-4832-4028-b94f-57ba13c86614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:25.160275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7ac35397-4832-4028-b94f-57ba13c86614 None None] MFA Rules not processed for user `d344ee3c6b914c24a6f319147004dcf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:25.161548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7ac35397-4832-4028-b94f-57ba13c86614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:25.236052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1261/2528] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:25.246962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a2e15-5aa9-4e69-9d1d-ecaba16d740b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:25.248753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-293a2e15-5aa9-4e69-9d1d-ecaba16d740b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:25.315351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a2e15-5aa9-4e69-9d1d-ecaba16d740b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:25.319384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bed816-9c46-488e-a950-605c0d86166e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:25.319995 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bed816-9c46-488e-a950-605c0d86166e service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:25.320276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bed816-9c46-488e-a950-605c0d86166e service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:25.320554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bed816-9c46-488e-a950-605c0d86166e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:25.330630 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bed816-9c46-488e-a950-605c0d86166e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:25.332294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bed816-9c46-488e-a950-605c0d86166e service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:25.342607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1268/2529] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:19:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:26.769140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfbe60-2fc5-4102-8ffb-a91055b4bd9e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:26.769757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfbe60-2fc5-4102-8ffb-a91055b4bd9e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:26.769757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfbe60-2fc5-4102-8ffb-a91055b4bd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:26.794535 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-50dfbe60-2fc5-4102-8ffb-a91055b4bd9e None None] MFA Rules not processed for user `d344ee3c6b914c24a6f319147004dcf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:26.795760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-50dfbe60-2fc5-4102-8ffb-a91055b4bd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:26.804483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1262/2530] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:35.338252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:36.787041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:37.974554 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193e910-1277-4476-b069-c850878fcc35 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:37.975026 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193e910-1277-4476-b069-c850878fcc35 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:37.975272 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193e910-1277-4476-b069-c850878fcc35 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:37.977178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1269/2531] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:19:37.984498 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4ee1c-4724-4191-b785-e6dd50b5b989 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:37.985010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4ee1c-4724-4191-b785-e6dd50b5b989 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:37.985218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4ee1c-4724-4191-b785-e6dd50b5b989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:38.005282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-87a4ee1c-4724-4191-b785-e6dd50b5b989 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:38.006531 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-87a4ee1c-4724-4191-b785-e6dd50b5b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:38.079912 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1263/2532] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:19:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:38.094357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193e910-1277-4476-b069-c850878fcc35 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:38.096276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d193e910-1277-4476-b069-c850878fcc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:38.167277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193e910-1277-4476-b069-c850878fcc35 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:38.170777 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5f591-068b-4875-a135-83a8b19ed405 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f20fbf033f04036b48194a804dae8c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:38.171409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f591-068b-4875-a135-83a8b19ed405 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:38.171796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f591-068b-4875-a135-83a8b19ed405 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:38.172064 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f591-068b-4875-a135-83a8b19ed405 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:38.182914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5f591-068b-4875-a135-83a8b19ed405 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:38.184363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5f591-068b-4875-a135-83a8b19ed405 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:38.196528 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1270/2533] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:19:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:38.266759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6ed01-ef5f-458d-8ff6-70c26e0dcee1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:38.267200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6ed01-ef5f-458d-8ff6-70c26e0dcee1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:38.267548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6ed01-ef5f-458d-8ff6-70c26e0dcee1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:38.268890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1264/2534] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:19:38.274214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec52531-ee4d-4916-8ae9-58518a3338d4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:38.274588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec52531-ee4d-4916-8ae9-58518a3338d4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:38.274927 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec52531-ee4d-4916-8ae9-58518a3338d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:38.296188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8ec52531-ee4d-4916-8ae9-58518a3338d4 None None] MFA Rules not processed for user `4fe0dabaf0ef4fc7b417d378334413c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:38.298244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ec52531-ee4d-4916-8ae9-58518a3338d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:38.352834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1271/2535] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:38.365934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6ed01-ef5f-458d-8ff6-70c26e0dcee1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:38.367634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c6c6ed01-ef5f-458d-8ff6-70c26e0dcee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:38.381075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6ed01-ef5f-458d-8ff6-70c26e0dcee1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:38.384648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382d7fc-0576-48fd-98b1-31accaadb746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:38.385237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d7fc-0576-48fd-98b1-31accaadb746 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:38.385598 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d7fc-0576-48fd-98b1-31accaadb746 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:38.385899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d7fc-0576-48fd-98b1-31accaadb746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:38.392812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382d7fc-0576-48fd-98b1-31accaadb746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:38.394243 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382d7fc-0576-48fd-98b1-31accaadb746 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:38.401736 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1265/2536] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:19:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:19:38.487269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f97fc-fa08-4846-854e-6fe87c7ac835 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:38.487492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f97fc-fa08-4846-854e-6fe87c7ac835 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:38.487767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f97fc-fa08-4846-854e-6fe87c7ac835 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:38.489158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1272/2537] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 19 12:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:19:38.494693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d773fd-6dbd-420a-939b-1e292b4e3568 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:38.494975 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d773fd-6dbd-420a-939b-1e292b4e3568 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:38.495246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d773fd-6dbd-420a-939b-1e292b4e3568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:38.514722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-03d773fd-6dbd-420a-939b-1e292b4e3568 None None] MFA Rules not processed for user `02430b0097f94fa0a2015480a6ec68eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:38.516430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-03d773fd-6dbd-420a-939b-1e292b4e3568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:38.526317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1266/2538] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 19 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:38.538827 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f97fc-fa08-4846-854e-6fe87c7ac835 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:38.540765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-445f97fc-fa08-4846-854e-6fe87c7ac835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:38.554549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f97fc-fa08-4846-854e-6fe87c7ac835 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:38.558191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd78a56-f7ad-466a-b976-49bafdb7f2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:38.558781 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd78a56-f7ad-466a-b976-49bafdb7f2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:38.559062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd78a56-f7ad-466a-b976-49bafdb7f2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:38.559396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd78a56-f7ad-466a-b976-49bafdb7f2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:38.569856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd78a56-f7ad-466a-b976-49bafdb7f2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:38.571282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd78a56-f7ad-466a-b976-49bafdb7f2d2 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:38.583202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1273/2539] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:19:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:42.886083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb6a3d-53c5-42a4-bcc1-2c6032f644da None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:42.886563 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb6a3d-53c5-42a4-bcc1-2c6032f644da None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:42.886656 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb6a3d-53c5-42a4-bcc1-2c6032f644da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:42.906996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b2cb6a3d-53c5-42a4-bcc1-2c6032f644da None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:42.908363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b2cb6a3d-53c5-42a4-bcc1-2c6032f644da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:42.977597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1267/2540] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:19:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:43.000999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd78a56-f7ad-466a-b976-49bafdb7f2d2 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:43.002710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cdd78a56-f7ad-466a-b976-49bafdb7f2d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:43.077198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd78a56-f7ad-466a-b976-49bafdb7f2d2 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:43.082962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9fc13-b2af-41e7-9faf-2173cc155278 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:43.083576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9fc13-b2af-41e7-9faf-2173cc155278 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:43.083857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9fc13-b2af-41e7-9faf-2173cc155278 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:43.084131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9fc13-b2af-41e7-9faf-2173cc155278 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:43.095114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9fc13-b2af-41e7-9faf-2173cc155278 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:43.096717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9fc13-b2af-41e7-9faf-2173cc155278 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:43.105036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1274/2541] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:19:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:19:43.510183 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1b1fb-a6e3-4a15-b0d0-322ac2dea32c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:43.511062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1b1fb-a6e3-4a15-b0d0-322ac2dea32c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:43.511635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1b1fb-a6e3-4a15-b0d0-322ac2dea32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:43.533394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-77c1b1fb-a6e3-4a15-b0d0-322ac2dea32c None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:43.534658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-77c1b1fb-a6e3-4a15-b0d0-322ac2dea32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:43.542308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1268/2542] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:19:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:43.565858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9fc13-b2af-41e7-9faf-2173cc155278 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:43.576749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9fc13-b2af-41e7-9faf-2173cc155278 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:43.591231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163081e6-2b0f-4539-a62d-1a7f982899c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:43.592313 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163081e6-2b0f-4539-a62d-1a7f982899c5 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:43.592911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163081e6-2b0f-4539-a62d-1a7f982899c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:43.593129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163081e6-2b0f-4539-a62d-1a7f982899c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:43.602767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163081e6-2b0f-4539-a62d-1a7f982899c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:43.604417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163081e6-2b0f-4539-a62d-1a7f982899c5 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:43.614939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1275/2543] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:19:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:19:44.182697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420bcf2-d42e-4842-8a36-e33555a497b7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:44.183177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420bcf2-d42e-4842-8a36-e33555a497b7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:44.183504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420bcf2-d42e-4842-8a36-e33555a497b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:44.203697 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4420bcf2-d42e-4842-8a36-e33555a497b7 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:44.205014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4420bcf2-d42e-4842-8a36-e33555a497b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:44.213968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1269/2544] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 19 12:19:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:44.242106 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163081e6-2b0f-4539-a62d-1a7f982899c5 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:44.256047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163081e6-2b0f-4539-a62d-1a7f982899c5 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:44.262279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbd4d3-22a5-4901-a714-af2a206083e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:44.263025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbd4d3-22a5-4901-a714-af2a206083e3 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:44.263435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbd4d3-22a5-4901-a714-af2a206083e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:44.263791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbd4d3-22a5-4901-a714-af2a206083e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:44.274683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbd4d3-22a5-4901-a714-af2a206083e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:44.276908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbd4d3-22a5-4901-a714-af2a206083e3 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:44.287946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1276/2545] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:19:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:19:44.582690 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b964f-f8c9-4d64-b948-ebf7cd0e3559 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:44.583286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b964f-f8c9-4d64-b948-ebf7cd0e3559 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:44.583904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b964f-f8c9-4d64-b948-ebf7cd0e3559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:44.604790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9a5b964f-f8c9-4d64-b948-ebf7cd0e3559 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:44.606013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9a5b964f-f8c9-4d64-b948-ebf7cd0e3559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:44.614202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1270/2546] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 19 12:19:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:44.627035 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbd4d3-22a5-4901-a714-af2a206083e3 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:44.632228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:44.638760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbd4d3-22a5-4901-a714-af2a206083e3 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:44.643761 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91def646-03e0-4846-a664-c4bb5c9eebc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:44.644380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91def646-03e0-4846-a664-c4bb5c9eebc3 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:44.644661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91def646-03e0-4846-a664-c4bb5c9eebc3 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:44.644933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91def646-03e0-4846-a664-c4bb5c9eebc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:44.652811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91def646-03e0-4846-a664-c4bb5c9eebc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:44.654453 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91def646-03e0-4846-a664-c4bb5c9eebc3 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:44.662672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1277/2547] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:19:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:19:45.008663 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0f37-169a-45f5-8692-0202d1c6f3d6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:45.008950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0f37-169a-45f5-8692-0202d1c6f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:45.009397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0f37-169a-45f5-8692-0202d1c6f3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:45.032151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-878e0f37-169a-45f5-8692-0202d1c6f3d6 None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:45.033678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-878e0f37-169a-45f5-8692-0202d1c6f3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:45.041593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1271/2548] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 19 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:19:45.070411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91def646-03e0-4846-a664-c4bb5c9eebc3 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:45.081352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91def646-03e0-4846-a664-c4bb5c9eebc3 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:45.086359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d320eb-756e-4011-8837-bd8f42bb3810 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:45.086947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d320eb-756e-4011-8837-bd8f42bb3810 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:45.087227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d320eb-756e-4011-8837-bd8f42bb3810 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:45.087497 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d320eb-756e-4011-8837-bd8f42bb3810 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:45.096115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d320eb-756e-4011-8837-bd8f42bb3810 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:45.097742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d320eb-756e-4011-8837-bd8f42bb3810 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:45.105892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1278/2549] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:19:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:19:47.395214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e0f37-169a-45f5-8692-0202d1c6f3d6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:47.465886 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:47.481330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e0f37-169a-45f5-8692-0202d1c6f3d6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:47.486305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:47.487473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:47.487752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:47.488024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] PATH_INFO: `/v3/users/d344ee3c6b914c24a6f319147004dcf8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:47.489156 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d344ee3c6b914c24a6f319147004dcf8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:47.491118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:47.548236 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd344ee3c6b914c24a6f319147004dcf8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:47.559079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd344ee3c6b914c24a6f319147004dcf8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:47.560457 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd344ee3c6b914c24a6f319147004dcf8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:47.561370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd344ee3c6b914c24a6f319147004dcf8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:47.570533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd344ee3c6b914c24a6f319147004dcf8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:47.588420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1272/2550] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:19:47 2022] DELETE /identity/v3/users/d344ee3c6b914c24a6f319147004dcf8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:19:47.593032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8305fb-89a7-45fc-898b-795cc887f4bf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:47.594144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8305fb-89a7-45fc-898b-795cc887f4bf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:47.594644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8305fb-89a7-45fc-898b-795cc887f4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:47.614019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4d8305fb-89a7-45fc-898b-795cc887f4bf None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:19:47.615293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4d8305fb-89a7-45fc-898b-795cc887f4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:47.686589 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1279/2551] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:19:47.696476 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:47.697907 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:47.761338 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d1d57-d6a1-4ba7-a8d2-7071706a0892 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:47.765725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb3da9-9bc3-40d6-9a0d-bc3d58730654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:47.766521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb3da9-9bc3-40d6-9a0d-bc3d58730654 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:47.766802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb3da9-9bc3-40d6-9a0d-bc3d58730654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:47.767073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb3da9-9bc3-40d6-9a0d-bc3d58730654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:47.776739 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb3da9-9bc3-40d6-9a0d-bc3d58730654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:47.778208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb3da9-9bc3-40d6-9a0d-bc3d58730654 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:47.788889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1273/2552] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:19:48.010208 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8305fb-89a7-45fc-898b-795cc887f4bf None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:48.012003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4d8305fb-89a7-45fc-898b-795cc887f4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:48.033067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8305fb-89a7-45fc-898b-795cc887f4bf None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:48.043714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:48.044368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:48.044645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:48.044910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] PATH_INFO: `/v3/projects/01e2ab7186e64a7595a8e0995aa3732a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:48.046083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e2ab7186e64a7595a8e0995aa3732a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:48.048065 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:48.101350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e2ab7186e64a7595a8e0995aa3732a', 'request_id': 'req-1c0f052f-b1ab-447b-935c-276aeb8782f8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:48.108017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e2ab7186e64a7595a8e0995aa3732a', 'request_id': 'req-1c0f052f-b1ab-447b-935c-276aeb8782f8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:48.118529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e2ab7186e64a7595a8e0995aa3732a', 'request_id': 'req-1c0f052f-b1ab-447b-935c-276aeb8782f8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:48.132866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] The token cache is being invalidate because project 01e2ab7186e64a7595a8e0995aa3732a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:19:48.133165 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:48.133849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c0f052f-b1ab-447b-935c-276aeb8782f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:19:48.135395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1280/2553] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:19:48 2022] DELETE /identity/v3/projects/01e2ab7186e64a7595a8e0995aa3732a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:19:57.784106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:58.129062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=65,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:58.720478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb3da9-9bc3-40d6-9a0d-bc3d58730654 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:19:58.741827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb3da9-9bc3-40d6-9a0d-bc3d58730654 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:19:58.816346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59444111-8e35-454a-92df-9424174fea50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:19:58.818049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59444111-8e35-454a-92df-9424174fea50 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:19:58.818049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59444111-8e35-454a-92df-9424174fea50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:19:58.818049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59444111-8e35-454a-92df-9424174fea50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:19:58.820822 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-59444111-8e35-454a-92df-9424174fea50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:19:59.056156 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59444111-8e35-454a-92df-9424174fea50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:19:59.057590 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59444111-8e35-454a-92df-9424174fea50 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:19:59.067373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1274/2554] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:19:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:20:03.718692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ae3f1-d0f1-4b75-a690-e8456a2118ec None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:03.719188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ae3f1-d0f1-4b75-a690-e8456a2118ec None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:03.719458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ae3f1-d0f1-4b75-a690-e8456a2118ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:03.751117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-254ae3f1-d0f1-4b75-a690-e8456a2118ec None None] MFA Rules not processed for user `42d7224dbe7944789327082192495039`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:03.752250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-254ae3f1-d0f1-4b75-a690-e8456a2118ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:03.821083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1281/2555] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 19 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:03.834291 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59444111-8e35-454a-92df-9424174fea50 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:03.835786 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-59444111-8e35-454a-92df-9424174fea50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:03.917306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59444111-8e35-454a-92df-9424174fea50 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:03.922712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037a924-e11d-4cb7-bc57-f1f378b2856e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b33b44f0e354c16846dd87179131141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:03.923358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037a924-e11d-4cb7-bc57-f1f378b2856e service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:03.923627 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037a924-e11d-4cb7-bc57-f1f378b2856e service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:03.923895 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037a924-e11d-4cb7-bc57-f1f378b2856e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:03.929574 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:03.931953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037a924-e11d-4cb7-bc57-f1f378b2856e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:03.933806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037a924-e11d-4cb7-bc57-f1f378b2856e service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:03.941815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1275/2556] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 19 12:20:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:20:06.257545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ae3f1-d0f1-4b75-a690-e8456a2118ec None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:06.259016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-254ae3f1-d0f1-4b75-a690-e8456a2118ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:06.270972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ae3f1-d0f1-4b75-a690-e8456a2118ec None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:06.274540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963ed32-299e-4f9a-91da-4fd61f0b9fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:06.275143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ed32-299e-4f9a-91da-4fd61f0b9fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:06.275426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ed32-299e-4f9a-91da-4fd61f0b9fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:06.275702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ed32-299e-4f9a-91da-4fd61f0b9fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:06.277436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8963ed32-299e-4f9a-91da-4fd61f0b9fe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:06.367805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963ed32-299e-4f9a-91da-4fd61f0b9fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:06.369901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963ed32-299e-4f9a-91da-4fd61f0b9fe1 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:06.389466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1282/2557] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:12.803530 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037a924-e11d-4cb7-bc57-f1f378b2856e service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:12.805075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8037a924-e11d-4cb7-bc57-f1f378b2856e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:12.826605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037a924-e11d-4cb7-bc57-f1f378b2856e service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:12.831317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:12.831941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:12.832217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:12.832487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] PATH_INFO: `/v3/users/cd2edb3eefa5428e97b4742d70f719b9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:12.833597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2edb3eefa5428e97b4742d70f719b9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:12.835513 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:12.882606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2edb3eefa5428e97b4742d70f719b9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:12.890044 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2edb3eefa5428e97b4742d70f719b9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:12.890670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2edb3eefa5428e97b4742d70f719b9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:12.891270 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2edb3eefa5428e97b4742d70f719b9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:12.898203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2edb3eefa5428e97b4742d70f719b9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:12.915794 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1276/2558] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:12 2022] DELETE /identity/v3/users/cd2edb3eefa5428e97b4742d70f719b9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:13.090460 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963ed32-299e-4f9a-91da-4fd61f0b9fe1 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:13.101264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963ed32-299e-4f9a-91da-4fd61f0b9fe1 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:13.151718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:13.160300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:13.160943 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:13.161218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:13.161492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] PATH_INFO: `/v3/projects/84119b21feab40a3994de11471beace3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:13.162649 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84119b21feab40a3994de11471beace3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:13.164576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:13.211593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84119b21feab40a3994de11471beace3', 'request_id': 'req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.217140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84119b21feab40a3994de11471beace3', 'request_id': 'req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.227641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84119b21feab40a3994de11471beace3', 'request_id': 'req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.247783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] The token cache is being invalidate because project 84119b21feab40a3994de11471beace3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:13.248138 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.248771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.251306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1283/2559] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:13 2022] DELETE /identity/v3/projects/84119b21feab40a3994de11471beace3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:13.256304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:13.258179 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:13.272040 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc68997-9e09-43fb-988b-ff2ece6dff45 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:13.330556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:13.331291 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:13.331565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:13.331830 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] PATH_INFO: `/v3/users/5935e6b505174f0c9a437b303bbbf24f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:13.332965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5935e6b505174f0c9a437b303bbbf24f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:13.334880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:13.385041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5935e6b505174f0c9a437b303bbbf24f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.393005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5935e6b505174f0c9a437b303bbbf24f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.393812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5935e6b505174f0c9a437b303bbbf24f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.394483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5935e6b505174f0c9a437b303bbbf24f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.401518 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5935e6b505174f0c9a437b303bbbf24f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.408468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:13.427510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1277/2560] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:13 2022] DELETE /identity/v3/users/5935e6b505174f0c9a437b303bbbf24f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:13.606415 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:13.609051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:13.624267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea5a14-a368-44dd-a385-987e8e3cd6e9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:13.691046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:13.691767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:13.692131 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:13.692473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] PATH_INFO: `/v3/projects/a8f5abb0e25d427c9127e635c13843ca` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:13.693684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f5abb0e25d427c9127e635c13843ca)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:13.695654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:13.747681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f5abb0e25d427c9127e635c13843ca', 'request_id': 'req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.753876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f5abb0e25d427c9127e635c13843ca', 'request_id': 'req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.765493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f5abb0e25d427c9127e635c13843ca', 'request_id': 'req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.776651 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] The token cache is being invalidate because project a8f5abb0e25d427c9127e635c13843ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:13.776945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.777586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:13.779113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1284/2561] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:13 2022] DELETE /identity/v3/projects/a8f5abb0e25d427c9127e635c13843ca => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:17.461220 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:17.462674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:17.561059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61316a69-d3b3-4933-a959-8e89d46fd978 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:17.622930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc30247-674f-48cd-b226-453218abf14d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:17.623460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc30247-674f-48cd-b226-453218abf14d service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:17.623918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc30247-674f-48cd-b226-453218abf14d service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:17.624204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc30247-674f-48cd-b226-453218abf14d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:17.626070 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2cc30247-674f-48cd-b226-453218abf14d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:17.637350 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc30247-674f-48cd-b226-453218abf14d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:17.638941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc30247-674f-48cd-b226-453218abf14d service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:17.649541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1278/2562] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:23.063832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:23.065297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:23.084666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:23.145898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb31a8-ed7e-44ed-a73d-b0847fb2b4a8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:23.149495 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252995-5abd-47b5-8f4f-398a37b6bf05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:23.150120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252995-5abd-47b5-8f4f-398a37b6bf05 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:23.150398 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252995-5abd-47b5-8f4f-398a37b6bf05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:23.150671 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252995-5abd-47b5-8f4f-398a37b6bf05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:23.152409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3c252995-5abd-47b5-8f4f-398a37b6bf05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:23.216338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c252995-5abd-47b5-8f4f-398a37b6bf05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:23.217974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c252995-5abd-47b5-8f4f-398a37b6bf05 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:23.227699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1285/2563] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:26.362632 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc30247-674f-48cd-b226-453218abf14d service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:26.364205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2cc30247-674f-48cd-b226-453218abf14d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:26.382872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc30247-674f-48cd-b226-453218abf14d service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:26.388521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:26.389937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:26.390327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:26.390703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] PATH_INFO: `/v3/users/421b120ee015472bb530542ca9418589` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:26.391962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421b120ee015472bb530542ca9418589)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:26.394053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:26.450947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421b120ee015472bb530542ca9418589'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:26.458446 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421b120ee015472bb530542ca9418589'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:26.459130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421b120ee015472bb530542ca9418589'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:26.459718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421b120ee015472bb530542ca9418589'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:26.460894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:26.469827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7af6a300-af2c-4013-9dbe-9b00e050a3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421b120ee015472bb530542ca9418589'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:26.487274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1279/2564] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:26 2022] DELETE /identity/v3/users/421b120ee015472bb530542ca9418589 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:26.664094 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252995-5abd-47b5-8f4f-398a37b6bf05 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:26.692260 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252995-5abd-47b5-8f4f-398a37b6bf05 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:26.751047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:26.751715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:26.751968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:26.752244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] PATH_INFO: `/v3/projects/7091ebd30b0349c3bb4cd7b6ecf9d547` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:26.753381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7091ebd30b0349c3bb4cd7b6ecf9d547)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:26.755394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:26.803893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:26.805539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7091ebd30b0349c3bb4cd7b6ecf9d547', 'request_id': 'req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:26.812335 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7091ebd30b0349c3bb4cd7b6ecf9d547', 'request_id': 'req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:26.819626 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7091ebd30b0349c3bb4cd7b6ecf9d547', 'request_id': 'req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:26.831379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] The token cache is being invalidate because project 7091ebd30b0349c3bb4cd7b6ecf9d547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:26.831677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:26.832309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1d051be4-d3fb-4f03-a46e-3e88ea0ed49b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:26.833808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1286/2565] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:26 2022] DELETE /identity/v3/projects/7091ebd30b0349c3bb4cd7b6ecf9d547 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:26.838646 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46b1e-6ae8-4e5b-a674-10b8d5bb6464 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:26.838935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46b1e-6ae8-4e5b-a674-10b8d5bb6464 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:26.839213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46b1e-6ae8-4e5b-a674-10b8d5bb6464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:26.895387 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-49c46b1e-6ae8-4e5b-a674-10b8d5bb6464 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:26.896577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-49c46b1e-6ae8-4e5b-a674-10b8d5bb6464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:26.953821 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1280/2566] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:26.961765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f1169-0806-4f7f-9ef8-28d25dd4cd4a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:26.962053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f1169-0806-4f7f-9ef8-28d25dd4cd4a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:26.962331 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f1169-0806-4f7f-9ef8-28d25dd4cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:26.981782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d26f1169-0806-4f7f-9ef8-28d25dd4cd4a None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:26.982990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d26f1169-0806-4f7f-9ef8-28d25dd4cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:26.991172 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1287/2567] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:26.995497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46b1e-6ae8-4e5b-a674-10b8d5bb6464 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:27.006427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46b1e-6ae8-4e5b-a674-10b8d5bb6464 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:27.011226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faaee6-0649-4715-96e6-54d3cddae4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:27.011827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faaee6-0649-4715-96e6-54d3cddae4ff admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:27.012129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faaee6-0649-4715-96e6-54d3cddae4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:27.012425 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faaee6-0649-4715-96e6-54d3cddae4ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:27.013112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faaee6-0649-4715-96e6-54d3cddae4ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:20:27.013438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faaee6-0649-4715-96e6-54d3cddae4ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:27.016089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faaee6-0649-4715-96e6-54d3cddae4ff admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:27.027584 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1281/2568] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:20:27.031800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f1169-0806-4f7f-9ef8-28d25dd4cd4a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:27.040741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f1169-0806-4f7f-9ef8-28d25dd4cd4a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:27.045405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab1335-1153-453a-8a8d-aa9739a7319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:27.046329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab1335-1153-453a-8a8d-aa9739a7319f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:27.046610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab1335-1153-453a-8a8d-aa9739a7319f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:27.046885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab1335-1153-453a-8a8d-aa9739a7319f admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:27.047508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab1335-1153-453a-8a8d-aa9739a7319f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:27.049403 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab1335-1153-453a-8a8d-aa9739a7319f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:27.076306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1288/2569] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:27 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:27.081352 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faaee6-0649-4715-96e6-54d3cddae4ff admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:27.091005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faaee6-0649-4715-96e6-54d3cddae4ff admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:27.145762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b55721-f77e-48c7-93f9-bdf823dd0094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:27.146367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b55721-f77e-48c7-93f9-bdf823dd0094 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:27.146647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b55721-f77e-48c7-93f9-bdf823dd0094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:27.146918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b55721-f77e-48c7-93f9-bdf823dd0094 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:27.147537 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b55721-f77e-48c7-93f9-bdf823dd0094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:27.149450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b55721-f77e-48c7-93f9-bdf823dd0094 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:27.168845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1282/2570] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:27 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:27.173124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab1335-1153-453a-8a8d-aa9739a7319f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:27.183356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab1335-1153-453a-8a8d-aa9739a7319f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:27.188597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac60fb-0317-4721-9c21-d964d6aeedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:27.189196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac60fb-0317-4721-9c21-d964d6aeedb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:27.189465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac60fb-0317-4721-9c21-d964d6aeedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:27.189791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac60fb-0317-4721-9c21-d964d6aeedb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:27.190432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac60fb-0317-4721-9c21-d964d6aeedb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:27.192015 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac60fb-0317-4721-9c21-d964d6aeedb2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:27.202518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1289/2571] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:27.206163 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b55721-f77e-48c7-93f9-bdf823dd0094 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:27.215988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b55721-f77e-48c7-93f9-bdf823dd0094 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:27.220588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d5d62-f390-4f79-b405-8023f9694e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:27.221212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d5d62-f390-4f79-b405-8023f9694e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:27.221490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d5d62-f390-4f79-b405-8023f9694e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:27.221789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d5d62-f390-4f79-b405-8023f9694e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:27.222422 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d5d62-f390-4f79-b405-8023f9694e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:27.224043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d5d62-f390-4f79-b405-8023f9694e88 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:27.235427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1283/2572] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:27.239576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac60fb-0317-4721-9c21-d964d6aeedb2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:27.249801 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac60fb-0317-4721-9c21-d964d6aeedb2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:27.254434 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a346eb-bd19-444f-b4e7-38e4b5271ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:27.255077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a346eb-bd19-444f-b4e7-38e4b5271ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:27.255357 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a346eb-bd19-444f-b4e7-38e4b5271ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:27.255629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a346eb-bd19-444f-b4e7-38e4b5271ab1 admin admin] PATH_INFO: `/v3/projects/28adc53488b840a48937ff3bfb49ac78/users/f0cf2ea54e7747e1870944d0b3510909/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:27.270321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a346eb-bd19-444f-b4e7-38e4b5271ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28adc53488b840a48937ff3bfb49ac78, user_id=f0cf2ea54e7747e1870944d0b3510909, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:27.272938 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a346eb-bd19-444f-b4e7-38e4b5271ab1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:27.285974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1290/2573] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:27 2022] PUT /identity/v3/projects/28adc53488b840a48937ff3bfb49ac78/users/f0cf2ea54e7747e1870944d0b3510909/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:20:27.297386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d26dd-b4e6-4fd8-ac22-5995215df43a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:27.297726 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d26dd-b4e6-4fd8-ac22-5995215df43a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:27.298053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d26dd-b4e6-4fd8-ac22-5995215df43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:27.311702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:27.328894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6a0d26dd-b4e6-4fd8-ac22-5995215df43a None None] MFA Rules not processed for user `f0cf2ea54e7747e1870944d0b3510909`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:27.330135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6a0d26dd-b4e6-4fd8-ac22-5995215df43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:27.395777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1284/2574] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:27.407368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a346eb-bd19-444f-b4e7-38e4b5271ab1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:27.409027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-53a346eb-bd19-444f-b4e7-38e4b5271ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:27.502742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a346eb-bd19-444f-b4e7-38e4b5271ab1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:27.508242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff1056-6423-48f1-84a2-7203cc1ce54d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:27.508836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff1056-6423-48f1-84a2-7203cc1ce54d service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:27.509110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff1056-6423-48f1-84a2-7203cc1ce54d service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:27.509379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff1056-6423-48f1-84a2-7203cc1ce54d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:27.517524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff1056-6423-48f1-84a2-7203cc1ce54d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:27.519118 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff1056-6423-48f1-84a2-7203cc1ce54d service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:27.527666 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1291/2575] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:30.211468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d26dd-b4e6-4fd8-ac22-5995215df43a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:30.271808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d26dd-b4e6-4fd8-ac22-5995215df43a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:30.276195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:30.276819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:30.277098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:30.277367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] PATH_INFO: `/v3/users/f0cf2ea54e7747e1870944d0b3510909` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:30.278518 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0cf2ea54e7747e1870944d0b3510909)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:30.280999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:30.326220 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0cf2ea54e7747e1870944d0b3510909'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:30.333520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0cf2ea54e7747e1870944d0b3510909'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:30.334159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0cf2ea54e7747e1870944d0b3510909'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:30.334765 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0cf2ea54e7747e1870944d0b3510909'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:30.341514 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0cf2ea54e7747e1870944d0b3510909'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:30.358826 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1285/2576] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:30 2022] DELETE /identity/v3/users/f0cf2ea54e7747e1870944d0b3510909 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:30.363652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2d3b3-3a10-451e-99e9-bf4f2bca8783 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:30.364114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2d3b3-3a10-451e-99e9-bf4f2bca8783 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:30.364216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2d3b3-3a10-451e-99e9-bf4f2bca8783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:30.383148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c5b2d3b3-3a10-451e-99e9-bf4f2bca8783 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:30.384350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c5b2d3b3-3a10-451e-99e9-bf4f2bca8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:30.418202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:30.445935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1292/2577] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:30.457129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:30.458579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:30.477129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:30.516989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3e6e4-be84-4e93-9f6b-f41d943a1213 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:30.521504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a6ae3-4b55-42bd-bea7-8f01dcac4376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:30.522258 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6ae3-4b55-42bd-bea7-8f01dcac4376 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:30.522486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6ae3-4b55-42bd-bea7-8f01dcac4376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:30.522756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6ae3-4b55-42bd-bea7-8f01dcac4376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:30.532484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a6ae3-4b55-42bd-bea7-8f01dcac4376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:30.533933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a6ae3-4b55-42bd-bea7-8f01dcac4376 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:30.543296 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1286/2578] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:30.818461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2d3b3-3a10-451e-99e9-bf4f2bca8783 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:30.819881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c5b2d3b3-3a10-451e-99e9-bf4f2bca8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:30.835796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2d3b3-3a10-451e-99e9-bf4f2bca8783 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:30.840917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:30.841553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:30.841878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:30.842117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] PATH_INFO: `/v3/projects/28adc53488b840a48937ff3bfb49ac78` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:30.844149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=28adc53488b840a48937ff3bfb49ac78)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:30.846143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:30.893919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28adc53488b840a48937ff3bfb49ac78', 'request_id': 'req-c67b1203-04fd-41d3-97db-4f89c307fd6b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:30.899407 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28adc53488b840a48937ff3bfb49ac78', 'request_id': 'req-c67b1203-04fd-41d3-97db-4f89c307fd6b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:30.907538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28adc53488b840a48937ff3bfb49ac78', 'request_id': 'req-c67b1203-04fd-41d3-97db-4f89c307fd6b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:30.918533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] The token cache is being invalidate because project 28adc53488b840a48937ff3bfb49ac78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:30.918816 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:30.919437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67b1203-04fd-41d3-97db-4f89c307fd6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:30.921908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1293/2579] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:30 2022] DELETE /identity/v3/projects/28adc53488b840a48937ff3bfb49ac78 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:30.926751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e61ff-16ba-4b35-aacb-d6b46b5840b0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:30.927041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e61ff-16ba-4b35-aacb-d6b46b5840b0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:30.927311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e61ff-16ba-4b35-aacb-d6b46b5840b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:30.946112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3c5e61ff-16ba-4b35-aacb-d6b46b5840b0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:30.947288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3c5e61ff-16ba-4b35-aacb-d6b46b5840b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:31.006582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1287/2580] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:31.014815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53ba9-1e29-4730-91c6-2989c056a379 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.015105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53ba9-1e29-4730-91c6-2989c056a379 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.015382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53ba9-1e29-4730-91c6-2989c056a379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.035863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6bd53ba9-1e29-4730-91c6-2989c056a379 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:31.037062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6bd53ba9-1e29-4730-91c6-2989c056a379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:31.044865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1294/2581] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:31.049146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e61ff-16ba-4b35-aacb-d6b46b5840b0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.058674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e61ff-16ba-4b35-aacb-d6b46b5840b0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.063557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fad9a-1079-4851-a238-7017b7404ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.064090 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fad9a-1079-4851-a238-7017b7404ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.064367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fad9a-1079-4851-a238-7017b7404ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.064640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fad9a-1079-4851-a238-7017b7404ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.065276 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fad9a-1079-4851-a238-7017b7404ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:20:31.065578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fad9a-1079-4851-a238-7017b7404ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.067189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fad9a-1079-4851-a238-7017b7404ebd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.079122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1288/2582] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:20:31.083268 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd53ba9-1e29-4730-91c6-2989c056a379 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.092972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd53ba9-1e29-4730-91c6-2989c056a379 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.097910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d05c0-40a0-4cc2-80ea-4b5cf6ab79b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.098502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d05c0-40a0-4cc2-80ea-4b5cf6ab79b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.098784 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d05c0-40a0-4cc2-80ea-4b5cf6ab79b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.099056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d05c0-40a0-4cc2-80ea-4b5cf6ab79b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.099690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d05c0-40a0-4cc2-80ea-4b5cf6ab79b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.101569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d05c0-40a0-4cc2-80ea-4b5cf6ab79b1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.128594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1295/2583] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:31 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:31.133135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fad9a-1079-4851-a238-7017b7404ebd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.146190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fad9a-1079-4851-a238-7017b7404ebd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.204795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c6418-e3e5-488f-936e-de7f8dd5af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.205432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6418-e3e5-488f-936e-de7f8dd5af2a admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.205741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6418-e3e5-488f-936e-de7f8dd5af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.206018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6418-e3e5-488f-936e-de7f8dd5af2a admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.206640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c6418-e3e5-488f-936e-de7f8dd5af2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.208533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c6418-e3e5-488f-936e-de7f8dd5af2a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.228612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1289/2584] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:31 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:31.232914 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d05c0-40a0-4cc2-80ea-4b5cf6ab79b1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.243332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d05c0-40a0-4cc2-80ea-4b5cf6ab79b1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.247878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3bdd-07b5-44bb-8c02-cec7b878627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.248495 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3bdd-07b5-44bb-8c02-cec7b878627b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.248759 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3bdd-07b5-44bb-8c02-cec7b878627b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.249028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3bdd-07b5-44bb-8c02-cec7b878627b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.249698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d3bdd-07b5-44bb-8c02-cec7b878627b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.251267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d3bdd-07b5-44bb-8c02-cec7b878627b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.261261 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1296/2585] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:31.265846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c6418-e3e5-488f-936e-de7f8dd5af2a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.275610 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c6418-e3e5-488f-936e-de7f8dd5af2a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.280981 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca158917-4cd2-4fae-97f6-0c0fa9b5aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.281562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca158917-4cd2-4fae-97f6-0c0fa9b5aa62 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.281869 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca158917-4cd2-4fae-97f6-0c0fa9b5aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.282141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca158917-4cd2-4fae-97f6-0c0fa9b5aa62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.282770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca158917-4cd2-4fae-97f6-0c0fa9b5aa62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.284329 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca158917-4cd2-4fae-97f6-0c0fa9b5aa62 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.294546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1290/2586] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:31.298683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3bdd-07b5-44bb-8c02-cec7b878627b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.308390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3bdd-07b5-44bb-8c02-cec7b878627b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.313078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac370d69-6780-42af-b9e9-c0cd144db567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.313794 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac370d69-6780-42af-b9e9-c0cd144db567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.314019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac370d69-6780-42af-b9e9-c0cd144db567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.314292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac370d69-6780-42af-b9e9-c0cd144db567 admin admin] PATH_INFO: `/v3/projects/cce9f07896df406f898c3f009f1edcba/users/f28f759683bb4377a2f88a90a4dc1e0c/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.328839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac370d69-6780-42af-b9e9-c0cd144db567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce9f07896df406f898c3f009f1edcba, user_id=f28f759683bb4377a2f88a90a4dc1e0c, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.331473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac370d69-6780-42af-b9e9-c0cd144db567 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.344744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1297/2587] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:31 2022] PUT /identity/v3/projects/cce9f07896df406f898c3f009f1edcba/users/f28f759683bb4377a2f88a90a4dc1e0c/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:31.355332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5445-b0c8-4668-90fa-0e0be8b80a5f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.355616 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5445-b0c8-4668-90fa-0e0be8b80a5f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.355918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5445-b0c8-4668-90fa-0e0be8b80a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.384568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d08f5445-b0c8-4668-90fa-0e0be8b80a5f None None] MFA Rules not processed for user `f28f759683bb4377a2f88a90a4dc1e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:31.385782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d08f5445-b0c8-4668-90fa-0e0be8b80a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:31.397695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:31.450256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1291/2588] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:31.456139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac370d69-6780-42af-b9e9-c0cd144db567 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.513560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:31.518025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac370d69-6780-42af-b9e9-c0cd144db567 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.523796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be872651-4256-4121-be4e-8c8ae72765a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.524553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872651-4256-4121-be4e-8c8ae72765a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.525049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872651-4256-4121-be4e-8c8ae72765a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.525345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872651-4256-4121-be4e-8c8ae72765a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.526201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be872651-4256-4121-be4e-8c8ae72765a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.528145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be872651-4256-4121-be4e-8c8ae72765a5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.553467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1298/2589] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:31 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:20:31.557545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f5445-b0c8-4668-90fa-0e0be8b80a5f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.568438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f5445-b0c8-4668-90fa-0e0be8b80a5f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.622933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c861-fe21-46ae-8101-464bd0b8ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.624089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c861-fe21-46ae-8101-464bd0b8ef34 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.624365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c861-fe21-46ae-8101-464bd0b8ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.624633 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c861-fe21-46ae-8101-464bd0b8ef34 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.625259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252c861-fe21-46ae-8101-464bd0b8ef34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.627161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252c861-fe21-46ae-8101-464bd0b8ef34 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.648485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1292/2590] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:31 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:31.652448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be872651-4256-4121-be4e-8c8ae72765a5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.662542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be872651-4256-4121-be4e-8c8ae72765a5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.667139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421af8f-410c-4d70-8390-341738f8cf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.667769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421af8f-410c-4d70-8390-341738f8cf57 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.668047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421af8f-410c-4d70-8390-341738f8cf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.668322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421af8f-410c-4d70-8390-341738f8cf57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.668963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421af8f-410c-4d70-8390-341738f8cf57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.670587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421af8f-410c-4d70-8390-341738f8cf57 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.681355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1299/2591] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:31.685491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c861-fe21-46ae-8101-464bd0b8ef34 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.695856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c861-fe21-46ae-8101-464bd0b8ef34 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.700428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9304e0-c736-4540-acba-d293f0e9c2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.701073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9304e0-c736-4540-acba-d293f0e9c2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.701346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9304e0-c736-4540-acba-d293f0e9c2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.701634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9304e0-c736-4540-acba-d293f0e9c2e0 admin admin] PATH_INFO: `/v3/projects/8d3661107f6c4c399b937dc14d05d693/users/3344a0bafb5c40508b546a8969b143cd/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.716418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9304e0-c736-4540-acba-d293f0e9c2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3661107f6c4c399b937dc14d05d693, user_id=3344a0bafb5c40508b546a8969b143cd, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.719237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9304e0-c736-4540-acba-d293f0e9c2e0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.731948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1293/2592] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:31 2022] PUT /identity/v3/projects/8d3661107f6c4c399b937dc14d05d693/users/3344a0bafb5c40508b546a8969b143cd/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:31.736707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421af8f-410c-4d70-8390-341738f8cf57 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.746563 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421af8f-410c-4d70-8390-341738f8cf57 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.806022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33c0d7-2d2c-4fa7-9551-9d72a90a592f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.806657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c0d7-2d2c-4fa7-9551-9d72a90a592f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.806962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c0d7-2d2c-4fa7-9551-9d72a90a592f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.807257 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c0d7-2d2c-4fa7-9551-9d72a90a592f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.807928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33c0d7-2d2c-4fa7-9551-9d72a90a592f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.809604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33c0d7-2d2c-4fa7-9551-9d72a90a592f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.820702 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1300/2593] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:20:31.824801 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9304e0-c736-4540-acba-d293f0e9c2e0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.835061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9304e0-c736-4540-acba-d293f0e9c2e0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:31.839563 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e036-9261-496b-b06e-ee8d1c5ff813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:31.840201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e036-9261-496b-b06e-ee8d1c5ff813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.840475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e036-9261-496b-b06e-ee8d1c5ff813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.840742 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e036-9261-496b-b06e-ee8d1c5ff813 admin admin] PATH_INFO: `/v3/projects/8d3661107f6c4c399b937dc14d05d693/users/3344a0bafb5c40508b546a8969b143cd/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.842810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415e036-9261-496b-b06e-ee8d1c5ff813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3661107f6c4c399b937dc14d05d693, user_id=3344a0bafb5c40508b546a8969b143cd, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:31.845420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415e036-9261-496b-b06e-ee8d1c5ff813 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:31.855641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1294/2594] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:31 2022] PUT /identity/v3/projects/8d3661107f6c4c399b937dc14d05d693/users/3344a0bafb5c40508b546a8969b143cd/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:31.867778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2423b6-9e2f-446d-9f1a-444533cc55ee None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:31.868157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2423b6-9e2f-446d-9f1a-444533cc55ee None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:31.868539 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2423b6-9e2f-446d-9f1a-444533cc55ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:31.896364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3f2423b6-9e2f-446d-9f1a-444533cc55ee None None] MFA Rules not processed for user `3344a0bafb5c40508b546a8969b143cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:31.897551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3f2423b6-9e2f-446d-9f1a-444533cc55ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:31.963179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1301/2595] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:31.974671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e036-9261-496b-b06e-ee8d1c5ff813 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:31.976420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1415e036-9261-496b-b06e-ee8d1c5ff813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:32.050835 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:32.055398 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e036-9261-496b-b06e-ee8d1c5ff813 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:32.059368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd1dae-8f1a-4f47-af55-60f92e8d3061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:32.059967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd1dae-8f1a-4f47-af55-60f92e8d3061 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:32.060246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd1dae-8f1a-4f47-af55-60f92e8d3061 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:32.060518 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd1dae-8f1a-4f47-af55-60f92e8d3061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:32.070090 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd1dae-8f1a-4f47-af55-60f92e8d3061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:32.071555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd1dae-8f1a-4f47-af55-60f92e8d3061 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:32.080947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1295/2596] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:32.460677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2423b6-9e2f-446d-9f1a-444533cc55ee None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:32.514891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:32.526854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2423b6-9e2f-446d-9f1a-444533cc55ee None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:32.532584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:32.533217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:32.533491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:32.533800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] PATH_INFO: `/v3/users/f28f759683bb4377a2f88a90a4dc1e0c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:32.534941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28f759683bb4377a2f88a90a4dc1e0c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:32.536852 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:32.581866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28f759683bb4377a2f88a90a4dc1e0c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:32.588826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28f759683bb4377a2f88a90a4dc1e0c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:32.589452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28f759683bb4377a2f88a90a4dc1e0c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:32.590094 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28f759683bb4377a2f88a90a4dc1e0c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:32.597743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28f759683bb4377a2f88a90a4dc1e0c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:32.616629 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1302/2597] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:32 2022] DELETE /identity/v3/users/f28f759683bb4377a2f88a90a4dc1e0c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:20:32.621061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed0828-9536-46e8-a3ef-697231e5fff5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:32.621538 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed0828-9536-46e8-a3ef-697231e5fff5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:32.621695 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed0828-9536-46e8-a3ef-697231e5fff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:32.640717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d1ed0828-9536-46e8-a3ef-697231e5fff5 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:32.641947 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d1ed0828-9536-46e8-a3ef-697231e5fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:32.698880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1296/2598] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:32.709376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:32.710834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:32.768856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7ae3-f22f-4775-9a39-e84046f1dae3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:32.772529 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd02c62-a19a-49d8-9089-a92e259e10ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:32.773125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02c62-a19a-49d8-9089-a92e259e10ef service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:32.773404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02c62-a19a-49d8-9089-a92e259e10ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:32.773715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02c62-a19a-49d8-9089-a92e259e10ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:32.783279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd02c62-a19a-49d8-9089-a92e259e10ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:32.784713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd02c62-a19a-49d8-9089-a92e259e10ef service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:32.794104 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1303/2599] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:33.061380 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed0828-9536-46e8-a3ef-697231e5fff5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:33.062946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d1ed0828-9536-46e8-a3ef-697231e5fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:33.075664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed0828-9536-46e8-a3ef-697231e5fff5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:33.081053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:33.081812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:33.082158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:33.082511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] PATH_INFO: `/v3/projects/cce9f07896df406f898c3f009f1edcba` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:33.083673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce9f07896df406f898c3f009f1edcba)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:33.085638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:33.142524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce9f07896df406f898c3f009f1edcba', 'request_id': 'req-ef22be24-d81b-452f-a2ca-8c81064a67b4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.150527 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce9f07896df406f898c3f009f1edcba', 'request_id': 'req-ef22be24-d81b-452f-a2ca-8c81064a67b4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.157022 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce9f07896df406f898c3f009f1edcba', 'request_id': 'req-ef22be24-d81b-452f-a2ca-8c81064a67b4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.168161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] The token cache is being invalidate because project cce9f07896df406f898c3f009f1edcba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:33.168454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.169093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.171169 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1297/2600] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:33 2022] DELETE /identity/v3/projects/cce9f07896df406f898c3f009f1edcba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:33.175380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd02c62-a19a-49d8-9089-a92e259e10ef service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:33.185455 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd02c62-a19a-49d8-9089-a92e259e10ef service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:33.244811 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:33.245441 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:33.245759 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:33.246034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] PATH_INFO: `/v3/users/3344a0bafb5c40508b546a8969b143cd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:33.247143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3344a0bafb5c40508b546a8969b143cd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:33.249134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:33.264037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:33.294848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3344a0bafb5c40508b546a8969b143cd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.303977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3344a0bafb5c40508b546a8969b143cd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.304606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3344a0bafb5c40508b546a8969b143cd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.305429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3344a0bafb5c40508b546a8969b143cd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.312491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-969fe56b-c23c-4321-acfd-13ec4b64dfd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3344a0bafb5c40508b546a8969b143cd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.330226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1304/2601] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:33 2022] DELETE /identity/v3/users/3344a0bafb5c40508b546a8969b143cd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:20:33.604262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:33.605733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:33.619795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22be24-d81b-452f-a2ca-8c81064a67b4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:33.677550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:33.678175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:33.678458 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:33.678731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] PATH_INFO: `/v3/projects/8d3661107f6c4c399b937dc14d05d693` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:33.679840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3661107f6c4c399b937dc14d05d693)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:33.681776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:33.698305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:33.730526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3661107f6c4c399b937dc14d05d693', 'request_id': 'req-7a1f6a93-d900-443e-8537-2c32f0136c2a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.737982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3661107f6c4c399b937dc14d05d693', 'request_id': 'req-7a1f6a93-d900-443e-8537-2c32f0136c2a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.743395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3661107f6c4c399b937dc14d05d693', 'request_id': 'req-7a1f6a93-d900-443e-8537-2c32f0136c2a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.755109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] The token cache is being invalidate because project 8d3661107f6c4c399b937dc14d05d693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:33.755410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.756027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a1f6a93-d900-443e-8537-2c32f0136c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:33.757475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1298/2602] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:33 2022] DELETE /identity/v3/projects/8d3661107f6c4c399b937dc14d05d693 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:20:33.762448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306d956-603e-4d9a-ab2f-9b16fcf63d02 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:33.762922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306d956-603e-4d9a-ab2f-9b16fcf63d02 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:33.763024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306d956-603e-4d9a-ab2f-9b16fcf63d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:33.782733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f306d956-603e-4d9a-ab2f-9b16fcf63d02 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:33.783936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f306d956-603e-4d9a-ab2f-9b16fcf63d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:33.841110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1305/2603] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:33.849185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd20d96-ad2d-4deb-8b14-673601c1bcc0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:33.849478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd20d96-ad2d-4deb-8b14-673601c1bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:33.849811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd20d96-ad2d-4deb-8b14-673601c1bcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:33.869168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bbd20d96-ad2d-4deb-8b14-673601c1bcc0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:33.870381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bbd20d96-ad2d-4deb-8b14-673601c1bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:33.878605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1299/2604] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:33.882814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306d956-603e-4d9a-ab2f-9b16fcf63d02 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:33.893889 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306d956-603e-4d9a-ab2f-9b16fcf63d02 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:33.898511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5c657-c0e9-46ed-858c-cdef1a5bf05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:33.899109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5c657-c0e9-46ed-858c-cdef1a5bf05a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:33.899391 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5c657-c0e9-46ed-858c-cdef1a5bf05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:33.899665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5c657-c0e9-46ed-858c-cdef1a5bf05a admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:33.900338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5c657-c0e9-46ed-858c-cdef1a5bf05a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:20:33.900641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5c657-c0e9-46ed-858c-cdef1a5bf05a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:33.902419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5c657-c0e9-46ed-858c-cdef1a5bf05a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:33.915223 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1306/2605] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:20:33.919517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd20d96-ad2d-4deb-8b14-673601c1bcc0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:33.928896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd20d96-ad2d-4deb-8b14-673601c1bcc0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:33.933410 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164946a-eef5-4f5f-bdf5-0e32e40a976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:33.934032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164946a-eef5-4f5f-bdf5-0e32e40a976f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:33.934311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164946a-eef5-4f5f-bdf5-0e32e40a976f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:33.934585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164946a-eef5-4f5f-bdf5-0e32e40a976f admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:33.935205 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164946a-eef5-4f5f-bdf5-0e32e40a976f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:33.937654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164946a-eef5-4f5f-bdf5-0e32e40a976f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:33.965071 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1300/2606] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:33 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:33.969244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5c657-c0e9-46ed-858c-cdef1a5bf05a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:33.979144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5c657-c0e9-46ed-858c-cdef1a5bf05a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.038013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863733eb-5668-4a39-8e31-dbdcf9ce1f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.038742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863733eb-5668-4a39-8e31-dbdcf9ce1f0e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.039052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863733eb-5668-4a39-8e31-dbdcf9ce1f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.039328 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863733eb-5668-4a39-8e31-dbdcf9ce1f0e admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.039965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863733eb-5668-4a39-8e31-dbdcf9ce1f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.041945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863733eb-5668-4a39-8e31-dbdcf9ce1f0e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.063440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1307/2607] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:33 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:20:34.067473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164946a-eef5-4f5f-bdf5-0e32e40a976f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.077781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164946a-eef5-4f5f-bdf5-0e32e40a976f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.082353 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d63fb-a28d-4426-8d51-5774583164a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.082940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d63fb-a28d-4426-8d51-5774583164a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.083218 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d63fb-a28d-4426-8d51-5774583164a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.083488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d63fb-a28d-4426-8d51-5774583164a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.084144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d63fb-a28d-4426-8d51-5774583164a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.085714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d63fb-a28d-4426-8d51-5774583164a8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.095474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1301/2608] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:34.099213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863733eb-5668-4a39-8e31-dbdcf9ce1f0e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.109500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863733eb-5668-4a39-8e31-dbdcf9ce1f0e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.114288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099755b-139f-4bd1-85d8-c0ffb65867b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.114864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099755b-139f-4bd1-85d8-c0ffb65867b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.115138 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099755b-139f-4bd1-85d8-c0ffb65867b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.115406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099755b-139f-4bd1-85d8-c0ffb65867b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.116033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099755b-139f-4bd1-85d8-c0ffb65867b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.117614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099755b-139f-4bd1-85d8-c0ffb65867b1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.122899 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:34.130105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1308/2609] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:34.134241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d63fb-a28d-4426-8d51-5774583164a8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.144497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d63fb-a28d-4426-8d51-5774583164a8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.148989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19eaef-8cae-4e6a-a3a2-dd1361daa61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.149647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19eaef-8cae-4e6a-a3a2-dd1361daa61f admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.149942 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19eaef-8cae-4e6a-a3a2-dd1361daa61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.150216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19eaef-8cae-4e6a-a3a2-dd1361daa61f admin admin] PATH_INFO: `/v3/projects/54f87e10ac18438ca8b0af06d643f756/users/c72ea1350d8a4d5c8d2b83e7364d38bd/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.164432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19eaef-8cae-4e6a-a3a2-dd1361daa61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f87e10ac18438ca8b0af06d643f756, user_id=c72ea1350d8a4d5c8d2b83e7364d38bd, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.167080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19eaef-8cae-4e6a-a3a2-dd1361daa61f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.180139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1302/2610] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:34 2022] PUT /identity/v3/projects/54f87e10ac18438ca8b0af06d643f756/users/c72ea1350d8a4d5c8d2b83e7364d38bd/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:34.190994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c717ee-e9f0-4d0f-a7fe-a1c529a2eb65 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.191303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c717ee-e9f0-4d0f-a7fe-a1c529a2eb65 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.191576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c717ee-e9f0-4d0f-a7fe-a1c529a2eb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.219188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d2c717ee-e9f0-4d0f-a7fe-a1c529a2eb65 None None] MFA Rules not processed for user `c72ea1350d8a4d5c8d2b83e7364d38bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:34.220387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d2c717ee-e9f0-4d0f-a7fe-a1c529a2eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:34.284770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1309/2611] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:34.289485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19eaef-8cae-4e6a-a3a2-dd1361daa61f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.349949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19eaef-8cae-4e6a-a3a2-dd1361daa61f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.354481 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37112e25-4a55-423b-b6d1-91c9fe336acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.355080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112e25-4a55-423b-b6d1-91c9fe336acc admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.355364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112e25-4a55-423b-b6d1-91c9fe336acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.355638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112e25-4a55-423b-b6d1-91c9fe336acc admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.356266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37112e25-4a55-423b-b6d1-91c9fe336acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.358692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37112e25-4a55-423b-b6d1-91c9fe336acc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.386746 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1303/2612] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:34 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:20:34.391464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c717ee-e9f0-4d0f-a7fe-a1c529a2eb65 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.402915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c717ee-e9f0-4d0f-a7fe-a1c529a2eb65 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.458951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4ad2e-ef16-49c9-8987-6091e8b00ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.459479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4ad2e-ef16-49c9-8987-6091e8b00ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.459758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4ad2e-ef16-49c9-8987-6091e8b00ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.460032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4ad2e-ef16-49c9-8987-6091e8b00ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.460656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4ad2e-ef16-49c9-8987-6091e8b00ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.462596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4ad2e-ef16-49c9-8987-6091e8b00ae7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.484358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1310/2613] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:34 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:20:34.488820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37112e25-4a55-423b-b6d1-91c9fe336acc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.499186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37112e25-4a55-423b-b6d1-91c9fe336acc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.503861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274a9bc-d12b-4e1a-a9a6-c82b758ce46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.504450 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274a9bc-d12b-4e1a-a9a6-c82b758ce46a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.504730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274a9bc-d12b-4e1a-a9a6-c82b758ce46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.505010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274a9bc-d12b-4e1a-a9a6-c82b758ce46a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.505685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274a9bc-d12b-4e1a-a9a6-c82b758ce46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.507300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274a9bc-d12b-4e1a-a9a6-c82b758ce46a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.517913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1304/2614] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:34.522086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4ad2e-ef16-49c9-8987-6091e8b00ae7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.532597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4ad2e-ef16-49c9-8987-6091e8b00ae7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.537100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fc901-14f9-43d4-b902-0766e881931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.537772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc901-14f9-43d4-b902-0766e881931e admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.538173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc901-14f9-43d4-b902-0766e881931e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.538594 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc901-14f9-43d4-b902-0766e881931e admin admin] PATH_INFO: `/v3/projects/6b8051b50f784f139d11f76ae9fd5dad/users/b96e51dbd7eb4c83aa40e96aa81a7c55/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.554115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fc901-14f9-43d4-b902-0766e881931e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8051b50f784f139d11f76ae9fd5dad, user_id=b96e51dbd7eb4c83aa40e96aa81a7c55, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.556730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fc901-14f9-43d4-b902-0766e881931e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.569178 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1311/2615] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:34 2022] PUT /identity/v3/projects/6b8051b50f784f139d11f76ae9fd5dad/users/b96e51dbd7eb4c83aa40e96aa81a7c55/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:34.573195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274a9bc-d12b-4e1a-a9a6-c82b758ce46a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.583041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274a9bc-d12b-4e1a-a9a6-c82b758ce46a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.591688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:34.640113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d738c7-0991-4663-8f8a-09c9ef35ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.641003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d738c7-0991-4663-8f8a-09c9ef35ad7d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.641314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d738c7-0991-4663-8f8a-09c9ef35ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.641592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d738c7-0991-4663-8f8a-09c9ef35ad7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.642251 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d738c7-0991-4663-8f8a-09c9ef35ad7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.643858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d738c7-0991-4663-8f8a-09c9ef35ad7d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.653324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1305/2616] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:34.658214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fc901-14f9-43d4-b902-0766e881931e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.668743 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fc901-14f9-43d4-b902-0766e881931e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.674203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1fe36-ec18-4929-941b-eb8bacd40d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.675098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1fe36-ec18-4929-941b-eb8bacd40d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.675098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1fe36-ec18-4929-941b-eb8bacd40d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.675379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1fe36-ec18-4929-941b-eb8bacd40d47 admin admin] PATH_INFO: `/v3/projects/6b8051b50f784f139d11f76ae9fd5dad/users/b96e51dbd7eb4c83aa40e96aa81a7c55/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.677279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1fe36-ec18-4929-941b-eb8bacd40d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8051b50f784f139d11f76ae9fd5dad, user_id=b96e51dbd7eb4c83aa40e96aa81a7c55, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.679911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1fe36-ec18-4929-941b-eb8bacd40d47 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.690396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1312/2617] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:34 2022] PUT /identity/v3/projects/6b8051b50f784f139d11f76ae9fd5dad/users/b96e51dbd7eb4c83aa40e96aa81a7c55/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:34.701644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f387d-3468-47dc-8de4-01df831c2c57 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.702121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f387d-3468-47dc-8de4-01df831c2c57 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.702216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f387d-3468-47dc-8de4-01df831c2c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.730042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-351f387d-3468-47dc-8de4-01df831c2c57 None None] MFA Rules not processed for user `b96e51dbd7eb4c83aa40e96aa81a7c55`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:34.731290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-351f387d-3468-47dc-8de4-01df831c2c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:34.797762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1306/2618] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:34.809155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1fe36-ec18-4929-941b-eb8bacd40d47 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.810892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cdc1fe36-ec18-4929-941b-eb8bacd40d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:34.859263 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:34.872195 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1fe36-ec18-4929-941b-eb8bacd40d47 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.875824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059b38c-abc2-413a-a80c-a5e8e37d49fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.876411 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059b38c-abc2-413a-a80c-a5e8e37d49fb service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.876685 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059b38c-abc2-413a-a80c-a5e8e37d49fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.876953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059b38c-abc2-413a-a80c-a5e8e37d49fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:34.885802 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059b38c-abc2-413a-a80c-a5e8e37d49fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:34.887212 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059b38c-abc2-413a-a80c-a5e8e37d49fb service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:34.897007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1313/2619] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:34.980207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f387d-3468-47dc-8de4-01df831c2c57 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:34.989970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f387d-3468-47dc-8de4-01df831c2c57 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:34.993576 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995cddf-09fe-4c9f-b415-95e3c9f1b6ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:34.994206 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cddf-09fe-4c9f-b415-95e3c9f1b6ab service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:34.994488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cddf-09fe-4c9f-b415-95e3c9f1b6ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:34.994789 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cddf-09fe-4c9f-b415-95e3c9f1b6ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:35.050734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995cddf-09fe-4c9f-b415-95e3c9f1b6ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:35.052152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995cddf-09fe-4c9f-b415-95e3c9f1b6ab service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:35.060766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1307/2620] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:42.060337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059b38c-abc2-413a-a80c-a5e8e37d49fb service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:42.120520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059b38c-abc2-413a-a80c-a5e8e37d49fb service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:42.125103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:42.125747 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:42.126024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:42.126295 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] PATH_INFO: `/v3/users/c72ea1350d8a4d5c8d2b83e7364d38bd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:42.127413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72ea1350d8a4d5c8d2b83e7364d38bd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:42.129310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:42.175613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72ea1350d8a4d5c8d2b83e7364d38bd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.182641 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72ea1350d8a4d5c8d2b83e7364d38bd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.183252 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72ea1350d8a4d5c8d2b83e7364d38bd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.183843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72ea1350d8a4d5c8d2b83e7364d38bd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.190602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72ea1350d8a4d5c8d2b83e7364d38bd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.206997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1314/2621] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:42 2022] DELETE /identity/v3/users/c72ea1350d8a4d5c8d2b83e7364d38bd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:42.211649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc712a-744c-4865-89aa-8f5757f404c5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:42.212118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc712a-744c-4865-89aa-8f5757f404c5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:42.212212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc712a-744c-4865-89aa-8f5757f404c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:42.231397 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f3dc712a-744c-4865-89aa-8f5757f404c5 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:42.232596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f3dc712a-744c-4865-89aa-8f5757f404c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:42.261989 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:42.292540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1308/2622] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:20:42.302363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:42.303782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:42.361964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bbf80-ad01-4b9a-8702-11afa7d4e36e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:42.365578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218c7cb-af05-4194-b1bd-7537c98b3c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:42.366199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218c7cb-af05-4194-b1bd-7537c98b3c09 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:42.366479 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218c7cb-af05-4194-b1bd-7537c98b3c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:42.366750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218c7cb-af05-4194-b1bd-7537c98b3c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:42.375712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218c7cb-af05-4194-b1bd-7537c98b3c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:42.377132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218c7cb-af05-4194-b1bd-7537c98b3c09 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:42.386461 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1315/2623] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:42.650718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc712a-744c-4865-89aa-8f5757f404c5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:42.652392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f3dc712a-744c-4865-89aa-8f5757f404c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:42.664544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc712a-744c-4865-89aa-8f5757f404c5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:42.674134 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:42.675174 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:42.675421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:42.675758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] PATH_INFO: `/v3/projects/54f87e10ac18438ca8b0af06d643f756` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:42.677020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f87e10ac18438ca8b0af06d643f756)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:42.679090 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:42.726671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f87e10ac18438ca8b0af06d643f756', 'request_id': 'req-8136d654-a11c-4403-aa5d-42516c0cbe76'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.735477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f87e10ac18438ca8b0af06d643f756', 'request_id': 'req-8136d654-a11c-4403-aa5d-42516c0cbe76'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.742023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f87e10ac18438ca8b0af06d643f756', 'request_id': 'req-8136d654-a11c-4403-aa5d-42516c0cbe76'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.753541 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] The token cache is being invalidate because project 54f87e10ac18438ca8b0af06d643f756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:42.753850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.754495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.755958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1309/2624] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:42 2022] DELETE /identity/v3/projects/54f87e10ac18438ca8b0af06d643f756 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:42.759939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218c7cb-af05-4194-b1bd-7537c98b3c09 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:42.770176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218c7cb-af05-4194-b1bd-7537c98b3c09 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:42.773644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:42.827741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:42.828366 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:42.828639 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:42.828903 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] PATH_INFO: `/v3/users/b96e51dbd7eb4c83aa40e96aa81a7c55` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:42.830037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96e51dbd7eb4c83aa40e96aa81a7c55)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:42.831926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:42.876769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96e51dbd7eb4c83aa40e96aa81a7c55'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.883768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96e51dbd7eb4c83aa40e96aa81a7c55'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.884378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96e51dbd7eb4c83aa40e96aa81a7c55'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.884969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96e51dbd7eb4c83aa40e96aa81a7c55'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.891929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d080aa7-ce6e-4b15-8316-4b79c7ae884e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96e51dbd7eb4c83aa40e96aa81a7c55'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:42.909349 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1316/2625] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:42 2022] DELETE /identity/v3/users/b96e51dbd7eb4c83aa40e96aa81a7c55 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:43.180185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:43.181765 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:43.196012 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136d654-a11c-4403-aa5d-42516c0cbe76 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:43.262701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:43.263394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.263539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.263819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] PATH_INFO: `/v3/projects/6b8051b50f784f139d11f76ae9fd5dad` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.265227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8051b50f784f139d11f76ae9fd5dad)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:43.267209 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:43.314057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8051b50f784f139d11f76ae9fd5dad', 'request_id': 'req-a4867e13-0822-4254-8584-430c758357e2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:43.322059 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8051b50f784f139d11f76ae9fd5dad', 'request_id': 'req-a4867e13-0822-4254-8584-430c758357e2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:43.323982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:43.329029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8051b50f784f139d11f76ae9fd5dad', 'request_id': 'req-a4867e13-0822-4254-8584-430c758357e2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:43.340867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] The token cache is being invalidate because project 6b8051b50f784f139d11f76ae9fd5dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:43.341161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:43.342229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a4867e13-0822-4254-8584-430c758357e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:43.343751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1310/2626] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:43 2022] DELETE /identity/v3/projects/6b8051b50f784f139d11f76ae9fd5dad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:43.348617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7e2a-1c9b-48ff-afb5-1bd9c9707c55 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.349116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7e2a-1c9b-48ff-afb5-1bd9c9707c55 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.349475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7e2a-1c9b-48ff-afb5-1bd9c9707c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.369145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-57ec7e2a-1c9b-48ff-afb5-1bd9c9707c55 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:43.370378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-57ec7e2a-1c9b-48ff-afb5-1bd9c9707c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:43.428560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1317/2627] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:43.436577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766d5a-edf9-463b-93c1-3e71b43e856d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.436859 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766d5a-edf9-463b-93c1-3e71b43e856d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.437152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766d5a-edf9-463b-93c1-3e71b43e856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.456754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0f766d5a-edf9-463b-93c1-3e71b43e856d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:43.457984 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0f766d5a-edf9-463b-93c1-3e71b43e856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:43.465675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1311/2628] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:43.470352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7e2a-1c9b-48ff-afb5-1bd9c9707c55 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:43.480091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7e2a-1c9b-48ff-afb5-1bd9c9707c55 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:43.485718 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465cfed-05d7-40a4-80c5-1da2b09de827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:43.486317 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465cfed-05d7-40a4-80c5-1da2b09de827 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.486711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465cfed-05d7-40a4-80c5-1da2b09de827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.486993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465cfed-05d7-40a4-80c5-1da2b09de827 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.487640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465cfed-05d7-40a4-80c5-1da2b09de827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:20:43.487951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465cfed-05d7-40a4-80c5-1da2b09de827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:43.489537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465cfed-05d7-40a4-80c5-1da2b09de827 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:43.501044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1318/2629] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:20:43.505127 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f766d5a-edf9-463b-93c1-3e71b43e856d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:43.514108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f766d5a-edf9-463b-93c1-3e71b43e856d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:43.518556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1905e-a556-40bd-b8cc-f5b63b528eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:43.519142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1905e-a556-40bd-b8cc-f5b63b528eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.519414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1905e-a556-40bd-b8cc-f5b63b528eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.519680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1905e-a556-40bd-b8cc-f5b63b528eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.520306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1905e-a556-40bd-b8cc-f5b63b528eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:43.522184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1905e-a556-40bd-b8cc-f5b63b528eb9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:43.550061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1312/2630] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:43 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:43.554152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465cfed-05d7-40a4-80c5-1da2b09de827 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:43.564168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465cfed-05d7-40a4-80c5-1da2b09de827 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:43.572934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:43.621480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dd81d-e973-435d-be41-a6ff2f980f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:43.622222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dd81d-e973-435d-be41-a6ff2f980f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.622501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dd81d-e973-435d-be41-a6ff2f980f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.622772 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dd81d-e973-435d-be41-a6ff2f980f48 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.623935 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4dd81d-e973-435d-be41-a6ff2f980f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:43.625894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4dd81d-e973-435d-be41-a6ff2f980f48 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:43.647887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1319/2631] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:43 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:20:43.652067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1905e-a556-40bd-b8cc-f5b63b528eb9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:43.662321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1905e-a556-40bd-b8cc-f5b63b528eb9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:43.666864 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e4cd-56c7-4c9e-8212-21c79d5b89b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:43.667896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e4cd-56c7-4c9e-8212-21c79d5b89b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.668174 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e4cd-56c7-4c9e-8212-21c79d5b89b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.668449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e4cd-56c7-4c9e-8212-21c79d5b89b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.669112 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18e4cd-56c7-4c9e-8212-21c79d5b89b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:43.670837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18e4cd-56c7-4c9e-8212-21c79d5b89b3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:43.680931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1313/2632] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:43.684907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dd81d-e973-435d-be41-a6ff2f980f48 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:43.695584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dd81d-e973-435d-be41-a6ff2f980f48 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:43.700379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e0d0a-6f4e-445e-88bb-a1f78ec912e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:43.700976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0d0a-6f4e-445e-88bb-a1f78ec912e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.701255 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0d0a-6f4e-445e-88bb-a1f78ec912e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.702289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0d0a-6f4e-445e-88bb-a1f78ec912e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.702979 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e0d0a-6f4e-445e-88bb-a1f78ec912e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:43.704558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e0d0a-6f4e-445e-88bb-a1f78ec912e4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:43.715120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1320/2633] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:43.719479 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e4cd-56c7-4c9e-8212-21c79d5b89b3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:43.729146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e4cd-56c7-4c9e-8212-21c79d5b89b3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:43.734202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425f037-c2b0-428c-aa83-bdfc0888e7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:43.735094 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425f037-c2b0-428c-aa83-bdfc0888e7c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.735375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425f037-c2b0-428c-aa83-bdfc0888e7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.735647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425f037-c2b0-428c-aa83-bdfc0888e7c6 admin admin] PATH_INFO: `/v3/projects/2af7e279015a41a49ce108c16ac5060d/users/41db814b52444e8ca97c2296f9a7fa39/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.750186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425f037-c2b0-428c-aa83-bdfc0888e7c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af7e279015a41a49ce108c16ac5060d, user_id=41db814b52444e8ca97c2296f9a7fa39, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:43.752781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425f037-c2b0-428c-aa83-bdfc0888e7c6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:43.765315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1314/2634] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:43 2022] PUT /identity/v3/projects/2af7e279015a41a49ce108c16ac5060d/users/41db814b52444e8ca97c2296f9a7fa39/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:43.776420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71284-96ef-46d2-93f2-946c32233bb5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.776707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71284-96ef-46d2-93f2-946c32233bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.776982 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71284-96ef-46d2-93f2-946c32233bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.804146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-27e71284-96ef-46d2-93f2-946c32233bb5 None None] MFA Rules not processed for user `41db814b52444e8ca97c2296f9a7fa39`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:43.805358 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-27e71284-96ef-46d2-93f2-946c32233bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:43.869504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1321/2635] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:43.874782 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425f037-c2b0-428c-aa83-bdfc0888e7c6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:43.935621 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425f037-c2b0-428c-aa83-bdfc0888e7c6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:43.940770 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18211049-572f-468c-ab27-edde94ab4b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:43.941372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18211049-572f-468c-ab27-edde94ab4b4d admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:43.941675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18211049-572f-468c-ab27-edde94ab4b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:43.941950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18211049-572f-468c-ab27-edde94ab4b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:43.942567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18211049-572f-468c-ab27-edde94ab4b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:43.944546 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18211049-572f-468c-ab27-edde94ab4b4d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:43.970693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1315/2636] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:43 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:43.974857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e71284-96ef-46d2-93f2-946c32233bb5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:43.986293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e71284-96ef-46d2-93f2-946c32233bb5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:44.046371 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3593a32-78ee-4f14-af99-dfab912e7f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:44.046972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3593a32-78ee-4f14-af99-dfab912e7f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:44.047402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3593a32-78ee-4f14-af99-dfab912e7f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:44.047677 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3593a32-78ee-4f14-af99-dfab912e7f79 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:44.048309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3593a32-78ee-4f14-af99-dfab912e7f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:44.050290 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3593a32-78ee-4f14-af99-dfab912e7f79 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:44.070894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1322/2637] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:43 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:44.074983 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18211049-572f-468c-ab27-edde94ab4b4d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:44.085977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18211049-572f-468c-ab27-edde94ab4b4d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:44.090585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9ceee-0325-443f-8d8d-67edc4f7dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:44.091238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9ceee-0325-443f-8d8d-67edc4f7dd65 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:44.091517 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9ceee-0325-443f-8d8d-67edc4f7dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:44.091791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9ceee-0325-443f-8d8d-67edc4f7dd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:44.092463 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9ceee-0325-443f-8d8d-67edc4f7dd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:44.094074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9ceee-0325-443f-8d8d-67edc4f7dd65 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:44.104441 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1316/2638] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:44.108977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3593a32-78ee-4f14-af99-dfab912e7f79 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:44.118913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3593a32-78ee-4f14-af99-dfab912e7f79 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:44.124027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a4882-e652-4803-9e54-ebaeb880007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:44.124684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a4882-e652-4803-9e54-ebaeb880007a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:44.124934 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a4882-e652-4803-9e54-ebaeb880007a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:44.125202 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a4882-e652-4803-9e54-ebaeb880007a admin admin] PATH_INFO: `/v3/projects/8418d031809942b282895b990ef1cc59/users/15df3027224e49a4bc15def3d6214866/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:44.133566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:44.142032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a4882-e652-4803-9e54-ebaeb880007a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8418d031809942b282895b990ef1cc59, user_id=15df3027224e49a4bc15def3d6214866, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:44.144696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a4882-e652-4803-9e54-ebaeb880007a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:44.157296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1323/2639] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:44 2022] PUT /identity/v3/projects/8418d031809942b282895b990ef1cc59/users/15df3027224e49a4bc15def3d6214866/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:20:44.161159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9ceee-0325-443f-8d8d-67edc4f7dd65 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:44.171675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9ceee-0325-443f-8d8d-67edc4f7dd65 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:44.220619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:44.227324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba4922-6cea-40d9-828e-7039292d3eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:44.227941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba4922-6cea-40d9-828e-7039292d3eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:44.228401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba4922-6cea-40d9-828e-7039292d3eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:44.228850 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba4922-6cea-40d9-828e-7039292d3eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:44.230024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba4922-6cea-40d9-828e-7039292d3eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:44.231926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba4922-6cea-40d9-828e-7039292d3eb2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:44.251385 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1317/2640] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:44.255907 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a4882-e652-4803-9e54-ebaeb880007a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:44.266516 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a4882-e652-4803-9e54-ebaeb880007a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:44.271116 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2c7b-7363-4b9d-b6fe-16ff9bbbf0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:44.271764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2c7b-7363-4b9d-b6fe-16ff9bbbf0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:44.272044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2c7b-7363-4b9d-b6fe-16ff9bbbf0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:44.272322 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2c7b-7363-4b9d-b6fe-16ff9bbbf0c9 admin admin] PATH_INFO: `/v3/projects/8418d031809942b282895b990ef1cc59/users/15df3027224e49a4bc15def3d6214866/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:44.274315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2c7b-7363-4b9d-b6fe-16ff9bbbf0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8418d031809942b282895b990ef1cc59, user_id=15df3027224e49a4bc15def3d6214866, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:44.276860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2c7b-7363-4b9d-b6fe-16ff9bbbf0c9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:44.287698 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1324/2641] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:44 2022] PUT /identity/v3/projects/8418d031809942b282895b990ef1cc59/users/15df3027224e49a4bc15def3d6214866/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:44.298701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6d6f-a95c-4822-8561-a28eff437a08 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:44.299187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6d6f-a95c-4822-8561-a28eff437a08 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:44.299284 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6d6f-a95c-4822-8561-a28eff437a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:44.326761 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-312a6d6f-a95c-4822-8561-a28eff437a08 None None] MFA Rules not processed for user `15df3027224e49a4bc15def3d6214866`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:44.327939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-312a6d6f-a95c-4822-8561-a28eff437a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:44.398126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1318/2642] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:44.410506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2c7b-7363-4b9d-b6fe-16ff9bbbf0c9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:44.412287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-db8c2c7b-7363-4b9d-b6fe-16ff9bbbf0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:44.475673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2c7b-7363-4b9d-b6fe-16ff9bbbf0c9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:44.479740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd6c8e-66da-44f2-af09-15fdcd36b1b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:44.480419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd6c8e-66da-44f2-af09-15fdcd36b1b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:44.480749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd6c8e-66da-44f2-af09-15fdcd36b1b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:44.481052 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd6c8e-66da-44f2-af09-15fdcd36b1b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:44.543642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd6c8e-66da-44f2-af09-15fdcd36b1b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:44.545218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd6c8e-66da-44f2-af09-15fdcd36b1b5 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:44.555216 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1325/2643] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:45.912043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6d6f-a95c-4822-8561-a28eff437a08 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:45.913455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-312a6d6f-a95c-4822-8561-a28eff437a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:45.926078 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6d6f-a95c-4822-8561-a28eff437a08 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:45.929526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1120ae5-ea10-4864-8a70-71027019597b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:45.930147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1120ae5-ea10-4864-8a70-71027019597b service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:45.930423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1120ae5-ea10-4864-8a70-71027019597b service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:45.930689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1120ae5-ea10-4864-8a70-71027019597b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:45.939394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1120ae5-ea10-4864-8a70-71027019597b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:45.940790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1120ae5-ea10-4864-8a70-71027019597b service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:45.949927 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1319/2644] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:49.722238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd6c8e-66da-44f2-af09-15fdcd36b1b5 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:49.783288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd6c8e-66da-44f2-af09-15fdcd36b1b5 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:49.787831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:49.788455 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:49.788735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:49.789009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] PATH_INFO: `/v3/users/41db814b52444e8ca97c2296f9a7fa39` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:49.790300 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=41db814b52444e8ca97c2296f9a7fa39)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:49.792208 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:49.825337 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:49.840075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41db814b52444e8ca97c2296f9a7fa39'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:49.847128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41db814b52444e8ca97c2296f9a7fa39'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:49.847800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41db814b52444e8ca97c2296f9a7fa39'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:49.848393 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41db814b52444e8ca97c2296f9a7fa39'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:49.855211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41db814b52444e8ca97c2296f9a7fa39'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:49.875003 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1326/2645] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:49 2022] DELETE /identity/v3/users/41db814b52444e8ca97c2296f9a7fa39 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:49.879389 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa0607-955f-4d7d-b138-71acfe17a1bb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:49.879872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa0607-955f-4d7d-b138-71acfe17a1bb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:49.879972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa0607-955f-4d7d-b138-71acfe17a1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:49.898709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4aaa0607-955f-4d7d-b138-71acfe17a1bb None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:49.899881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4aaa0607-955f-4d7d-b138-71acfe17a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:49.956100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1320/2646] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:20:49.965882 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:49.967331 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:50.025674 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92d34a-77b6-4a96-bb4a-fd5663cad0ab admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:50.029652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda865af-6d78-49c0-bc2d-c595c8857dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:50.030264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda865af-6d78-49c0-bc2d-c595c8857dfe service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:50.030588 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda865af-6d78-49c0-bc2d-c595c8857dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:50.030885 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda865af-6d78-49c0-bc2d-c595c8857dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:50.040897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda865af-6d78-49c0-bc2d-c595c8857dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:50.042480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda865af-6d78-49c0-bc2d-c595c8857dfe service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:50.052881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1327/2647] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:50.313041 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa0607-955f-4d7d-b138-71acfe17a1bb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:50.314489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4aaa0607-955f-4d7d-b138-71acfe17a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:50.326029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa0607-955f-4d7d-b138-71acfe17a1bb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:50.330673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:50.331910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:50.332186 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:50.332675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] PATH_INFO: `/v3/projects/2af7e279015a41a49ce108c16ac5060d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:50.333825 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af7e279015a41a49ce108c16ac5060d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:50.335710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:50.385024 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af7e279015a41a49ce108c16ac5060d', 'request_id': 'req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.392958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af7e279015a41a49ce108c16ac5060d', 'request_id': 'req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.396946 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:50.399619 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af7e279015a41a49ce108c16ac5060d', 'request_id': 'req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.412555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] The token cache is being invalidate because project 2af7e279015a41a49ce108c16ac5060d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:50.412840 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.413585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.415144 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1321/2648] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:50 2022] DELETE /identity/v3/projects/2af7e279015a41a49ce108c16ac5060d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:50.419283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda865af-6d78-49c0-bc2d-c595c8857dfe service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:50.429747 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda865af-6d78-49c0-bc2d-c595c8857dfe service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:50.486585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:50.487207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:50.487486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:50.487754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] PATH_INFO: `/v3/users/15df3027224e49a4bc15def3d6214866` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:50.488894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15df3027224e49a4bc15def3d6214866)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:50.490888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:50.536384 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15df3027224e49a4bc15def3d6214866'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.539915 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:50.545201 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15df3027224e49a4bc15def3d6214866'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.546155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15df3027224e49a4bc15def3d6214866'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.547171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15df3027224e49a4bc15def3d6214866'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.554556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c7b6fbab-93b7-4a57-b64b-76aa3eadece8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15df3027224e49a4bc15def3d6214866'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.571620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1328/2649] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:50 2022] DELETE /identity/v3/users/15df3027224e49a4bc15def3d6214866 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:50.848126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:50.849898 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:50.865354 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34c17c-0f6a-4f4f-9621-0132bfb6db24 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:50.925067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:50.925772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:50.926003 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:50.926281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] PATH_INFO: `/v3/projects/8418d031809942b282895b990ef1cc59` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:50.927394 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8418d031809942b282895b990ef1cc59)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:50.929278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:50.975400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8418d031809942b282895b990ef1cc59', 'request_id': 'req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.982010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8418d031809942b282895b990ef1cc59', 'request_id': 'req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.988149 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8418d031809942b282895b990ef1cc59', 'request_id': 'req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:50.999784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] The token cache is being invalidate because project 8418d031809942b282895b990ef1cc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:51.000063 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:51.000683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a5c6a9c7-7fab-4dfb-a58e-bc880370a82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:51.002184 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1322/2650] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:50 2022] DELETE /identity/v3/projects/8418d031809942b282895b990ef1cc59 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:20:51.007050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ea3d1-abcf-4b83-a917-dc3aed1b9ff2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.007531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ea3d1-abcf-4b83-a917-dc3aed1b9ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.007643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ea3d1-abcf-4b83-a917-dc3aed1b9ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.035741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-819ea3d1-abcf-4b83-a917-dc3aed1b9ff2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:51.036879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-819ea3d1-abcf-4b83-a917-dc3aed1b9ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:51.103046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1329/2651] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:51.111124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67ad61-1867-4c1a-a5ef-56f83d2ea1df None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.111414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67ad61-1867-4c1a-a5ef-56f83d2ea1df None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.111694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67ad61-1867-4c1a-a5ef-56f83d2ea1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.131641 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2d67ad61-1867-4c1a-a5ef-56f83d2ea1df None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:51.132822 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2d67ad61-1867-4c1a-a5ef-56f83d2ea1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:51.141427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1323/2652] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:51.145673 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ea3d1-abcf-4b83-a917-dc3aed1b9ff2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.155148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ea3d1-abcf-4b83-a917-dc3aed1b9ff2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.159686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c926b-f847-49c3-a9fb-e27446cd70c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.160312 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c926b-f847-49c3-a9fb-e27446cd70c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.160591 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c926b-f847-49c3-a9fb-e27446cd70c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.160865 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c926b-f847-49c3-a9fb-e27446cd70c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.161502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c926b-f847-49c3-a9fb-e27446cd70c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:20:51.161842 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c926b-f847-49c3-a9fb-e27446cd70c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.163436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c926b-f847-49c3-a9fb-e27446cd70c2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.174785 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1330/2653] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:20:51.178847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67ad61-1867-4c1a-a5ef-56f83d2ea1df None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.188375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67ad61-1867-4c1a-a5ef-56f83d2ea1df None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.192977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf019c4-80c8-483c-a1df-96eff1f75ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.193580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf019c4-80c8-483c-a1df-96eff1f75ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.193884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf019c4-80c8-483c-a1df-96eff1f75ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.194152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf019c4-80c8-483c-a1df-96eff1f75ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.194780 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf019c4-80c8-483c-a1df-96eff1f75ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.196668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf019c4-80c8-483c-a1df-96eff1f75ef0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.224814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1324/2654] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:51 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:51.228863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c926b-f847-49c3-a9fb-e27446cd70c2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.239648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c926b-f847-49c3-a9fb-e27446cd70c2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.295620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda0bc8-152d-43a4-847c-a64e0255b16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.296150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda0bc8-152d-43a4-847c-a64e0255b16f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.296423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda0bc8-152d-43a4-847c-a64e0255b16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.296696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda0bc8-152d-43a4-847c-a64e0255b16f admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.297305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda0bc8-152d-43a4-847c-a64e0255b16f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.299234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda0bc8-152d-43a4-847c-a64e0255b16f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.320210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1331/2655] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:51 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:51.324480 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf019c4-80c8-483c-a1df-96eff1f75ef0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.334439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf019c4-80c8-483c-a1df-96eff1f75ef0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.338998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bdd74-3947-4760-895a-05a766971713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.339585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bdd74-3947-4760-895a-05a766971713 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.339863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bdd74-3947-4760-895a-05a766971713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.340132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bdd74-3947-4760-895a-05a766971713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.340760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bdd74-3947-4760-895a-05a766971713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.342386 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bdd74-3947-4760-895a-05a766971713 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.352175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1325/2656] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:51.356149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda0bc8-152d-43a4-847c-a64e0255b16f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.367155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda0bc8-152d-43a4-847c-a64e0255b16f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.371713 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02291bf9-d449-4308-9808-a6fef5b9db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.372292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02291bf9-d449-4308-9808-a6fef5b9db63 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.372569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02291bf9-d449-4308-9808-a6fef5b9db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.372835 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02291bf9-d449-4308-9808-a6fef5b9db63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.374031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02291bf9-d449-4308-9808-a6fef5b9db63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.375584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02291bf9-d449-4308-9808-a6fef5b9db63 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.386226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1332/2657] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:51.390273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bdd74-3947-4760-895a-05a766971713 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.399839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bdd74-3947-4760-895a-05a766971713 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.404569 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43001d0f-5f4c-41b7-b40a-8a417cb0ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.405207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43001d0f-5f4c-41b7-b40a-8a417cb0ff03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.405486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43001d0f-5f4c-41b7-b40a-8a417cb0ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.405788 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43001d0f-5f4c-41b7-b40a-8a417cb0ff03 admin admin] PATH_INFO: `/v3/projects/8eed09548350484ba8e0a5906b7259e3/users/e918ee6595a34acba20d1ce00a873538/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.420699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43001d0f-5f4c-41b7-b40a-8a417cb0ff03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eed09548350484ba8e0a5906b7259e3, user_id=e918ee6595a34acba20d1ce00a873538, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.423355 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43001d0f-5f4c-41b7-b40a-8a417cb0ff03 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.436333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1326/2658] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:51 2022] PUT /identity/v3/projects/8eed09548350484ba8e0a5906b7259e3/users/e918ee6595a34acba20d1ce00a873538/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:51.447295 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0246-58a3-47be-9565-f94b0ebcaa13 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.447579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0246-58a3-47be-9565-f94b0ebcaa13 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.447850 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0246-58a3-47be-9565-f94b0ebcaa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.476978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2ace0246-58a3-47be-9565-f94b0ebcaa13 None None] MFA Rules not processed for user `e918ee6595a34acba20d1ce00a873538`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:51.478237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2ace0246-58a3-47be-9565-f94b0ebcaa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:51.503483 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:51.544447 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1333/2659] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:51.549800 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43001d0f-5f4c-41b7-b40a-8a417cb0ff03 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.567948 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:51.612467 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43001d0f-5f4c-41b7-b40a-8a417cb0ff03 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.617010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b598-f1bc-42e6-ba7e-1839b49e5e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.617611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b598-f1bc-42e6-ba7e-1839b49e5e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.617915 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b598-f1bc-42e6-ba7e-1839b49e5e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.618185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b598-f1bc-42e6-ba7e-1839b49e5e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.618814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2b598-f1bc-42e6-ba7e-1839b49e5e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.620671 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2b598-f1bc-42e6-ba7e-1839b49e5e62 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.647305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1327/2660] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:51 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:20:51.651507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace0246-58a3-47be-9565-f94b0ebcaa13 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.662981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace0246-58a3-47be-9565-f94b0ebcaa13 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.719690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9015fbb-ca8d-4b5b-953a-3022499f8767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.720292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9015fbb-ca8d-4b5b-953a-3022499f8767 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.720571 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9015fbb-ca8d-4b5b-953a-3022499f8767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.720843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9015fbb-ca8d-4b5b-953a-3022499f8767 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.721480 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9015fbb-ca8d-4b5b-953a-3022499f8767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.723410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9015fbb-ca8d-4b5b-953a-3022499f8767 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.747066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1334/2661] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:51 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:20:51.751281 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b598-f1bc-42e6-ba7e-1839b49e5e62 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.761711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b598-f1bc-42e6-ba7e-1839b49e5e62 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.766913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928f66c-e627-4e70-8601-70282af0ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.767511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928f66c-e627-4e70-8601-70282af0ef90 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.767793 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928f66c-e627-4e70-8601-70282af0ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.768069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928f66c-e627-4e70-8601-70282af0ef90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.768709 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928f66c-e627-4e70-8601-70282af0ef90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.770344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928f66c-e627-4e70-8601-70282af0ef90 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.781137 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1328/2662] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:51.785233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9015fbb-ca8d-4b5b-953a-3022499f8767 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.795803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9015fbb-ca8d-4b5b-953a-3022499f8767 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.800444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44e393-3613-4f83-a582-34d94c39d838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.801024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44e393-3613-4f83-a582-34d94c39d838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.801303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44e393-3613-4f83-a582-34d94c39d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.801577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44e393-3613-4f83-a582-34d94c39d838 admin admin] PATH_INFO: `/v3/projects/7dd0c44ede7e4a3fbe64a0dbfd8021a4/users/74a04bbb5f1046889c3f1bdd46073dc8/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.817593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44e393-3613-4f83-a582-34d94c39d838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd0c44ede7e4a3fbe64a0dbfd8021a4, user_id=74a04bbb5f1046889c3f1bdd46073dc8, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.820280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44e393-3613-4f83-a582-34d94c39d838 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.833503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1335/2663] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:51 2022] PUT /identity/v3/projects/7dd0c44ede7e4a3fbe64a0dbfd8021a4/users/74a04bbb5f1046889c3f1bdd46073dc8/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:51.837719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928f66c-e627-4e70-8601-70282af0ef90 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.848573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928f66c-e627-4e70-8601-70282af0ef90 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.903950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0db15a-0415-4ff1-a7ea-4f0bb1e76dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.905416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0db15a-0415-4ff1-a7ea-4f0bb1e76dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.905732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0db15a-0415-4ff1-a7ea-4f0bb1e76dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.906008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0db15a-0415-4ff1-a7ea-4f0bb1e76dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.906639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0db15a-0415-4ff1-a7ea-4f0bb1e76dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.908232 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0db15a-0415-4ff1-a7ea-4f0bb1e76dd5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.917694 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1329/2664] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:51.922499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44e393-3613-4f83-a582-34d94c39d838 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:51.932487 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44e393-3613-4f83-a582-34d94c39d838 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:51.937063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dbea6-0b3f-4c85-9503-c4b3a751d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:51.937732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dbea6-0b3f-4c85-9503-c4b3a751d712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.938013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dbea6-0b3f-4c85-9503-c4b3a751d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.938293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dbea6-0b3f-4c85-9503-c4b3a751d712 admin admin] PATH_INFO: `/v3/projects/7dd0c44ede7e4a3fbe64a0dbfd8021a4/users/74a04bbb5f1046889c3f1bdd46073dc8/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.940184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dbea6-0b3f-4c85-9503-c4b3a751d712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd0c44ede7e4a3fbe64a0dbfd8021a4, user_id=74a04bbb5f1046889c3f1bdd46073dc8, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:51.942817 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dbea6-0b3f-4c85-9503-c4b3a751d712 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:51.952788 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1336/2665] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:51 2022] PUT /identity/v3/projects/7dd0c44ede7e4a3fbe64a0dbfd8021a4/users/74a04bbb5f1046889c3f1bdd46073dc8/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:51.962862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5a602-f9bd-48b2-98f9-766d86eadb80 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:51.963360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5a602-f9bd-48b2-98f9-766d86eadb80 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:51.963483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5a602-f9bd-48b2-98f9-766d86eadb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:51.992384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e0a5a602-f9bd-48b2-98f9-766d86eadb80 None None] MFA Rules not processed for user `74a04bbb5f1046889c3f1bdd46073dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:51.993557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e0a5a602-f9bd-48b2-98f9-766d86eadb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:52.061602 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1330/2666] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:52.072177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dbea6-0b3f-4c85-9503-c4b3a751d712 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:52.073892 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b14dbea6-0b3f-4c85-9503-c4b3a751d712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:52.131007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dbea6-0b3f-4c85-9503-c4b3a751d712 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:52.134725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e9faa-fdf9-4f80-b155-33bb5c75c646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:52.135373 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e9faa-fdf9-4f80-b155-33bb5c75c646 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:52.135694 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e9faa-fdf9-4f80-b155-33bb5c75c646 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:52.135974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e9faa-fdf9-4f80-b155-33bb5c75c646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:52.146721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e9faa-fdf9-4f80-b155-33bb5c75c646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:52.148150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e9faa-fdf9-4f80-b155-33bb5c75c646 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:52.158429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1337/2667] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:52.260733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5a602-f9bd-48b2-98f9-766d86eadb80 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:52.270664 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5a602-f9bd-48b2-98f9-766d86eadb80 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:52.274190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f4ccc-e7d5-4361-98c3-0e28b8632060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:52.274780 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f4ccc-e7d5-4361-98c3-0e28b8632060 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:52.275052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f4ccc-e7d5-4361-98c3-0e28b8632060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:52.275321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f4ccc-e7d5-4361-98c3-0e28b8632060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:52.284053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:52.337917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f4ccc-e7d5-4361-98c3-0e28b8632060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:52.339305 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f4ccc-e7d5-4361-98c3-0e28b8632060 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:52.349132 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1331/2668] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:54.935992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e9faa-fdf9-4f80-b155-33bb5c75c646 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:54.957156 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:54.997796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e9faa-fdf9-4f80-b155-33bb5c75c646 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:55.002972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:55.003592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:55.003873 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:55.004148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] PATH_INFO: `/v3/users/e918ee6595a34acba20d1ce00a873538` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:55.005261 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e918ee6595a34acba20d1ce00a873538)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:55.007182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:55.050609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e918ee6595a34acba20d1ce00a873538'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.057467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e918ee6595a34acba20d1ce00a873538'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.058105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e918ee6595a34acba20d1ce00a873538'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.058704 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e918ee6595a34acba20d1ce00a873538'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.066426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e918ee6595a34acba20d1ce00a873538'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.083163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1338/2669] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:54 2022] DELETE /identity/v3/users/e918ee6595a34acba20d1ce00a873538 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:55.087640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb6610-43a8-4cab-ba80-daddc7783e9f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:55.088157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb6610-43a8-4cab-ba80-daddc7783e9f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:55.088275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb6610-43a8-4cab-ba80-daddc7783e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:55.107210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a5eb6610-43a8-4cab-ba80-daddc7783e9f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:55.109119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a5eb6610-43a8-4cab-ba80-daddc7783e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:55.167521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1332/2670] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:55.177828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:55.179213 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:55.237049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f1cc-4ff0-483f-aa16-41ae37f1ef97 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:55.240634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ce7a-252b-4a72-b8a9-df517ce3e725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:55.241226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ce7a-252b-4a72-b8a9-df517ce3e725 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:55.241502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ce7a-252b-4a72-b8a9-df517ce3e725 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:55.241804 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ce7a-252b-4a72-b8a9-df517ce3e725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:55.251140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909ce7a-252b-4a72-b8a9-df517ce3e725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:55.252544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909ce7a-252b-4a72-b8a9-df517ce3e725 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:55.261696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1339/2671] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:55.521562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb6610-43a8-4cab-ba80-daddc7783e9f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:55.523153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a5eb6610-43a8-4cab-ba80-daddc7783e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:55.536737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb6610-43a8-4cab-ba80-daddc7783e9f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:55.541385 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:55.542625 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:55.542916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:55.543414 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] PATH_INFO: `/v3/projects/8eed09548350484ba8e0a5906b7259e3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:55.544617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eed09548350484ba8e0a5906b7259e3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:55.547262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:55.594196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eed09548350484ba8e0a5906b7259e3', 'request_id': 'req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.601274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eed09548350484ba8e0a5906b7259e3', 'request_id': 'req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.606812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eed09548350484ba8e0a5906b7259e3', 'request_id': 'req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.617952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] The token cache is being invalidate because project 8eed09548350484ba8e0a5906b7259e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:55.618240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.618879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.620333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1333/2672] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:55 2022] DELETE /identity/v3/projects/8eed09548350484ba8e0a5906b7259e3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:55.624954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ce7a-252b-4a72-b8a9-df517ce3e725 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:55.634501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ce7a-252b-4a72-b8a9-df517ce3e725 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:55.676049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:55.695760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:55.696424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:55.696735 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:55.697012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] PATH_INFO: `/v3/users/74a04bbb5f1046889c3f1bdd46073dc8` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:55.698197 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a04bbb5f1046889c3f1bdd46073dc8)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:55.700128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:55.746724 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a04bbb5f1046889c3f1bdd46073dc8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.754508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a04bbb5f1046889c3f1bdd46073dc8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.755134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a04bbb5f1046889c3f1bdd46073dc8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.755869 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a04bbb5f1046889c3f1bdd46073dc8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.762836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c7f46774-449c-4e58-9c4b-f5fd545ff54b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a04bbb5f1046889c3f1bdd46073dc8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:55.783235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1340/2673] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:20:55 2022] DELETE /identity/v3/users/74a04bbb5f1046889c3f1bdd46073dc8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:56.056655 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.058163 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:56.072639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e7614-4e84-4b65-b7c7-73acdc0c10f4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.103139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:56.131330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.131960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.132237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.132515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] PATH_INFO: `/v3/projects/7dd0c44ede7e4a3fbe64a0dbfd8021a4` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.133613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd0c44ede7e4a3fbe64a0dbfd8021a4)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.135520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:56.180015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd0c44ede7e4a3fbe64a0dbfd8021a4', 'request_id': 'req-ce7080ad-6129-4413-b232-1b90ef5bf74e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:56.186738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd0c44ede7e4a3fbe64a0dbfd8021a4', 'request_id': 'req-ce7080ad-6129-4413-b232-1b90ef5bf74e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:56.192166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd0c44ede7e4a3fbe64a0dbfd8021a4', 'request_id': 'req-ce7080ad-6129-4413-b232-1b90ef5bf74e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:56.203049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] The token cache is being invalidate because project 7dd0c44ede7e4a3fbe64a0dbfd8021a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:20:56.203332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:56.203954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ce7080ad-6129-4413-b232-1b90ef5bf74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:20:56.205403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1334/2674] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:20:56 2022] DELETE /identity/v3/projects/7dd0c44ede7e4a3fbe64a0dbfd8021a4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:56.210518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345487-e4c8-4628-8e46-32ec54352b12 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.210987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345487-e4c8-4628-8e46-32ec54352b12 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.211083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345487-e4c8-4628-8e46-32ec54352b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.230699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-29345487-e4c8-4628-8e46-32ec54352b12 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:56.231906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-29345487-e4c8-4628-8e46-32ec54352b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:56.291581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1341/2675] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:56.301049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2b380-0c4a-43fd-b0bb-fb662d0ebff6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.301268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2b380-0c4a-43fd-b0bb-fb662d0ebff6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.301538 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2b380-0c4a-43fd-b0bb-fb662d0ebff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.321143 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0ff2b380-0c4a-43fd-b0bb-fb662d0ebff6 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:56.322362 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0ff2b380-0c4a-43fd-b0bb-fb662d0ebff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:56.330260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1335/2676] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:56.334405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29345487-e4c8-4628-8e46-32ec54352b12 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.344645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29345487-e4c8-4628-8e46-32ec54352b12 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.349222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fb1b1-1a1a-4bd8-86ec-c528000675c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.349841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fb1b1-1a1a-4bd8-86ec-c528000675c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.350238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fb1b1-1a1a-4bd8-86ec-c528000675c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.350518 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fb1b1-1a1a-4bd8-86ec-c528000675c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.351163 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fb1b1-1a1a-4bd8-86ec-c528000675c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:20:56.351467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fb1b1-1a1a-4bd8-86ec-c528000675c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.353045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fb1b1-1a1a-4bd8-86ec-c528000675c1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:56.365928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1342/2677] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:20:56.369903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2b380-0c4a-43fd-b0bb-fb662d0ebff6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.379009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2b380-0c4a-43fd-b0bb-fb662d0ebff6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.383515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77503285-3afc-4860-8aac-2608f29601c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.384102 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77503285-3afc-4860-8aac-2608f29601c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.384383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77503285-3afc-4860-8aac-2608f29601c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.384651 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77503285-3afc-4860-8aac-2608f29601c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.385268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77503285-3afc-4860-8aac-2608f29601c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.387147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77503285-3afc-4860-8aac-2608f29601c6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:56.413550 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1336/2678] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:56 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:56.417559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fb1b1-1a1a-4bd8-86ec-c528000675c1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.428306 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fb1b1-1a1a-4bd8-86ec-c528000675c1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.472468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:56.486525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85adb1e-50fc-4e78-8331-26e0b272d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.487126 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85adb1e-50fc-4e78-8331-26e0b272d819 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.487402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85adb1e-50fc-4e78-8331-26e0b272d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.487670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85adb1e-50fc-4e78-8331-26e0b272d819 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.488299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85adb1e-50fc-4e78-8331-26e0b272d819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.490276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85adb1e-50fc-4e78-8331-26e0b272d819 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:56.510475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1343/2679] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:56 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:20:56.515464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77503285-3afc-4860-8aac-2608f29601c6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.525604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77503285-3afc-4860-8aac-2608f29601c6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.531139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd90d84-1618-4db5-b884-0bb8ddda4f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.531731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd90d84-1618-4db5-b884-0bb8ddda4f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.532014 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd90d84-1618-4db5-b884-0bb8ddda4f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.532286 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd90d84-1618-4db5-b884-0bb8ddda4f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.532926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd90d84-1618-4db5-b884-0bb8ddda4f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.534542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd90d84-1618-4db5-b884-0bb8ddda4f37 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:56.544310 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1337/2680] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:56.552360 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85adb1e-50fc-4e78-8331-26e0b272d819 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.562239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85adb1e-50fc-4e78-8331-26e0b272d819 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.566765 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444630f6-936e-4962-ba7d-b85496803623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.567347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444630f6-936e-4962-ba7d-b85496803623 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.567624 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444630f6-936e-4962-ba7d-b85496803623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.567895 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444630f6-936e-4962-ba7d-b85496803623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.568531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444630f6-936e-4962-ba7d-b85496803623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.570194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444630f6-936e-4962-ba7d-b85496803623 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:56.581036 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1344/2681] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:56.585182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd90d84-1618-4db5-b884-0bb8ddda4f37 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.596263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd90d84-1618-4db5-b884-0bb8ddda4f37 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.600818 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab33bf-73ae-4812-b9f2-8cdcffdebf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.601459 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab33bf-73ae-4812-b9f2-8cdcffdebf26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.601755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab33bf-73ae-4812-b9f2-8cdcffdebf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.602028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab33bf-73ae-4812-b9f2-8cdcffdebf26 admin admin] PATH_INFO: `/v3/projects/6efc4709fde54c07bf75cfbe8de52aeb/users/244890dc598d4bc5bc99ed299d76a208/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.616551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab33bf-73ae-4812-b9f2-8cdcffdebf26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efc4709fde54c07bf75cfbe8de52aeb, user_id=244890dc598d4bc5bc99ed299d76a208, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.619252 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab33bf-73ae-4812-b9f2-8cdcffdebf26 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:56.631861 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1338/2682] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:56 2022] PUT /identity/v3/projects/6efc4709fde54c07bf75cfbe8de52aeb/users/244890dc598d4bc5bc99ed299d76a208/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:56.642752 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9e388-28f0-4463-a158-42f34b01030e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.643039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9e388-28f0-4463-a158-42f34b01030e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.643315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9e388-28f0-4463-a158-42f34b01030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.671723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-13a9e388-28f0-4463-a158-42f34b01030e None None] MFA Rules not processed for user `244890dc598d4bc5bc99ed299d76a208`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:56.673027 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-13a9e388-28f0-4463-a158-42f34b01030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:56.736583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1345/2683] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:20:56.741241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab33bf-73ae-4812-b9f2-8cdcffdebf26 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.800847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab33bf-73ae-4812-b9f2-8cdcffdebf26 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.805508 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b1d97-8f8d-4cd1-932b-8089383bca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.806135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b1d97-8f8d-4cd1-932b-8089383bca10 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.806412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b1d97-8f8d-4cd1-932b-8089383bca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.806683 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b1d97-8f8d-4cd1-932b-8089383bca10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.807295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b1d97-8f8d-4cd1-932b-8089383bca10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.809203 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b1d97-8f8d-4cd1-932b-8089383bca10 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:56.813638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:56.840345 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1339/2684] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:56 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:56.845169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9e388-28f0-4463-a158-42f34b01030e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.855911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9e388-28f0-4463-a158-42f34b01030e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.911562 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2cadb-5c5d-4de1-8ec8-53b0aed3f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.912153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2cadb-5c5d-4de1-8ec8-53b0aed3f4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.912428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2cadb-5c5d-4de1-8ec8-53b0aed3f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.912695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2cadb-5c5d-4de1-8ec8-53b0aed3f4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.913320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2cadb-5c5d-4de1-8ec8-53b0aed3f4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.915237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2cadb-5c5d-4de1-8ec8-53b0aed3f4f2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:56.935971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1346/2685] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:56 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:20:56.939964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b1d97-8f8d-4cd1-932b-8089383bca10 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.949870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b1d97-8f8d-4cd1-932b-8089383bca10 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.955101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c142f8-93f4-4597-9ee0-a6907a80a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.955692 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c142f8-93f4-4597-9ee0-a6907a80a522 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.955968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c142f8-93f4-4597-9ee0-a6907a80a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.956238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c142f8-93f4-4597-9ee0-a6907a80a522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.956862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c142f8-93f4-4597-9ee0-a6907a80a522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.958712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c142f8-93f4-4597-9ee0-a6907a80a522 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:56.968613 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1340/2686] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:56.972416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2cadb-5c5d-4de1-8ec8-53b0aed3f4f2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:56.982203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2cadb-5c5d-4de1-8ec8-53b0aed3f4f2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:56.987289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0dea3-3d5c-4036-9095-d288a52bf7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:56.987866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0dea3-3d5c-4036-9095-d288a52bf7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:56.988146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0dea3-3d5c-4036-9095-d288a52bf7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:56.988418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0dea3-3d5c-4036-9095-d288a52bf7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:56.989044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0dea3-3d5c-4036-9095-d288a52bf7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:56.990656 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0dea3-3d5c-4036-9095-d288a52bf7b1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:57.000913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1347/2687] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:57.004764 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c142f8-93f4-4597-9ee0-a6907a80a522 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:57.015048 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c142f8-93f4-4597-9ee0-a6907a80a522 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:57.019560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28613def-2660-4f65-8da6-ce48f282dc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:57.020215 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613def-2660-4f65-8da6-ce48f282dc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.020477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613def-2660-4f65-8da6-ce48f282dc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.020754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613def-2660-4f65-8da6-ce48f282dc71 admin admin] PATH_INFO: `/v3/projects/9523206d588e42b1afdd177e48b41137/users/d051759aae814761981e0e32b3c31b93/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.034939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28613def-2660-4f65-8da6-ce48f282dc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9523206d588e42b1afdd177e48b41137, user_id=d051759aae814761981e0e32b3c31b93, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:57.037542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28613def-2660-4f65-8da6-ce48f282dc71 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:57.049990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1341/2688] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:57 2022] PUT /identity/v3/projects/9523206d588e42b1afdd177e48b41137/users/d051759aae814761981e0e32b3c31b93/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:57.060338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0c38c-ce6c-40ae-bf93-ff4d2469f829 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.061136 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0c38c-ce6c-40ae-bf93-ff4d2469f829 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.061426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0c38c-ce6c-40ae-bf93-ff4d2469f829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.089823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-37b0c38c-ce6c-40ae-bf93-ff4d2469f829 None None] MFA Rules not processed for user `d051759aae814761981e0e32b3c31b93`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:57.091325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-37b0c38c-ce6c-40ae-bf93-ff4d2469f829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:57.115106 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:57.156582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1348/2689] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:20:57.161192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28613def-2660-4f65-8da6-ce48f282dc71 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:57.221066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28613def-2660-4f65-8da6-ce48f282dc71 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:57.225642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16702c-7950-4c35-8c77-5c6ce84edd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:57.226260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16702c-7950-4c35-8c77-5c6ce84edd06 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.226544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16702c-7950-4c35-8c77-5c6ce84edd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.226820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16702c-7950-4c35-8c77-5c6ce84edd06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.227442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16702c-7950-4c35-8c77-5c6ce84edd06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:57.229327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16702c-7950-4c35-8c77-5c6ce84edd06 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:57.255970 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1342/2690] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:20:57 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:57.260056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0c38c-ce6c-40ae-bf93-ff4d2469f829 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:57.270544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0c38c-ce6c-40ae-bf93-ff4d2469f829 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:57.326190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7df97e-b2e7-40ac-b23f-e9109b8ef4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:57.326716 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df97e-b2e7-40ac-b23f-e9109b8ef4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.326990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df97e-b2e7-40ac-b23f-e9109b8ef4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.327259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df97e-b2e7-40ac-b23f-e9109b8ef4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.327874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7df97e-b2e7-40ac-b23f-e9109b8ef4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:57.329791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7df97e-b2e7-40ac-b23f-e9109b8ef4f8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:57.350053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1349/2691] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:20:57 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:20:57.354113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16702c-7950-4c35-8c77-5c6ce84edd06 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:57.365492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16702c-7950-4c35-8c77-5c6ce84edd06 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:57.370095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd265901-d01f-4d8c-a1a2-a0ac3c1767bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:57.370686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd265901-d01f-4d8c-a1a2-a0ac3c1767bd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.370968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd265901-d01f-4d8c-a1a2-a0ac3c1767bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.371238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd265901-d01f-4d8c-a1a2-a0ac3c1767bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.371871 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd265901-d01f-4d8c-a1a2-a0ac3c1767bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:57.374313 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd265901-d01f-4d8c-a1a2-a0ac3c1767bd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:57.384566 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1343/2692] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:20:57.388551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7df97e-b2e7-40ac-b23f-e9109b8ef4f8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:57.398506 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7df97e-b2e7-40ac-b23f-e9109b8ef4f8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:57.403101 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186272d9-26a6-4ab8-8ede-cc0fe0b4dd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:57.403739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186272d9-26a6-4ab8-8ede-cc0fe0b4dd5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.404019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186272d9-26a6-4ab8-8ede-cc0fe0b4dd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.404329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186272d9-26a6-4ab8-8ede-cc0fe0b4dd5f admin admin] PATH_INFO: `/v3/projects/2b2e99ece64c43a79922c17e535f9e28/users/3be04ec500b842f3bad27f7b62013e16/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.419006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186272d9-26a6-4ab8-8ede-cc0fe0b4dd5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2e99ece64c43a79922c17e535f9e28, user_id=3be04ec500b842f3bad27f7b62013e16, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:57.422696 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186272d9-26a6-4ab8-8ede-cc0fe0b4dd5f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:57.435520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1350/2693] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:57 2022] PUT /identity/v3/projects/2b2e99ece64c43a79922c17e535f9e28/users/3be04ec500b842f3bad27f7b62013e16/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:57.440159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd265901-d01f-4d8c-a1a2-a0ac3c1767bd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:57.449845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd265901-d01f-4d8c-a1a2-a0ac3c1767bd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:57.507585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbbf66-100b-48eb-a230-8061f29c3188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:57.508194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbbf66-100b-48eb-a230-8061f29c3188 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.508478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbbf66-100b-48eb-a230-8061f29c3188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.508754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbbf66-100b-48eb-a230-8061f29c3188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.509392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbbf66-100b-48eb-a230-8061f29c3188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:57.511009 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbbf66-100b-48eb-a230-8061f29c3188 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:57.520652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1344/2694] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:20:57.524739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186272d9-26a6-4ab8-8ede-cc0fe0b4dd5f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:57.535111 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186272d9-26a6-4ab8-8ede-cc0fe0b4dd5f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:57.539699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a348b-f873-408e-96ba-3128a059eba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:57.540340 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a348b-f873-408e-96ba-3128a059eba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.540615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a348b-f873-408e-96ba-3128a059eba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.540888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a348b-f873-408e-96ba-3128a059eba6 admin admin] PATH_INFO: `/v3/projects/2b2e99ece64c43a79922c17e535f9e28/users/3be04ec500b842f3bad27f7b62013e16/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.542927 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a348b-f873-408e-96ba-3128a059eba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2e99ece64c43a79922c17e535f9e28, user_id=3be04ec500b842f3bad27f7b62013e16, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:57.546174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a348b-f873-408e-96ba-3128a059eba6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:57.556193 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1351/2695] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:20:57 2022] PUT /identity/v3/projects/2b2e99ece64c43a79922c17e535f9e28/users/3be04ec500b842f3bad27f7b62013e16/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:20:57.622995 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614db59-355e-4c8d-a401-a5fb9a921825 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.623811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614db59-355e-4c8d-a401-a5fb9a921825 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.624095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614db59-355e-4c8d-a401-a5fb9a921825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.651654 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a614db59-355e-4c8d-a401-a5fb9a921825 None None] MFA Rules not processed for user `3be04ec500b842f3bad27f7b62013e16`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:20:57.652986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a614db59-355e-4c8d-a401-a5fb9a921825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:57.662097 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:57.723250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1345/2696] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:20:57.735593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a348b-f873-408e-96ba-3128a059eba6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:57.737251 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c00a348b-f873-408e-96ba-3128a059eba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:57.796128 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a348b-f873-408e-96ba-3128a059eba6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:57.799838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964273a-333e-4c22-9c65-989b95f1c133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:57.800436 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964273a-333e-4c22-9c65-989b95f1c133 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.800719 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964273a-333e-4c22-9c65-989b95f1c133 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.800993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964273a-333e-4c22-9c65-989b95f1c133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.809928 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964273a-333e-4c22-9c65-989b95f1c133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:57.811643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964273a-333e-4c22-9c65-989b95f1c133 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:57.820945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1352/2697] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:20:57.863703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614db59-355e-4c8d-a401-a5fb9a921825 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:20:57.865175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a614db59-355e-4c8d-a401-a5fb9a921825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:20:57.877157 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614db59-355e-4c8d-a401-a5fb9a921825 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:20:57.880652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f895d74-ed76-4e3f-b1db-57f3cc06263b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:20:57.881245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f895d74-ed76-4e3f-b1db-57f3cc06263b service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:20:57.881520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f895d74-ed76-4e3f-b1db-57f3cc06263b service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:20:57.881812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f895d74-ed76-4e3f-b1db-57f3cc06263b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:20:57.937986 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f895d74-ed76-4e3f-b1db-57f3cc06263b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:20:57.939405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f895d74-ed76-4e3f-b1db-57f3cc06263b service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:20:57.948140 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1346/2698] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:20:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:00.869192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964273a-333e-4c22-9c65-989b95f1c133 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:00.889820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:00.931324 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964273a-333e-4c22-9c65-989b95f1c133 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:00.936069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:00.936690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:00.936969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:00.937241 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] PATH_INFO: `/v3/users/244890dc598d4bc5bc99ed299d76a208` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:00.938392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244890dc598d4bc5bc99ed299d76a208)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:00.940292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:00.986000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244890dc598d4bc5bc99ed299d76a208'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:00.993471 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244890dc598d4bc5bc99ed299d76a208'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:00.994152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244890dc598d4bc5bc99ed299d76a208'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:00.994769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244890dc598d4bc5bc99ed299d76a208'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.002010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244890dc598d4bc5bc99ed299d76a208'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.019521 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1353/2699] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:21:00 2022] DELETE /identity/v3/users/244890dc598d4bc5bc99ed299d76a208 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:01.023958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17c31b-d2f6-4d3f-bad5-9c46bbe0051f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:01.024439 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17c31b-d2f6-4d3f-bad5-9c46bbe0051f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:01.024607 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17c31b-d2f6-4d3f-bad5-9c46bbe0051f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:01.043833 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ba17c31b-d2f6-4d3f-bad5-9c46bbe0051f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:01.045066 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ba17c31b-d2f6-4d3f-bad5-9c46bbe0051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:01.102092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1347/2700] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:01.112152 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:01.113574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:01.170545 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82fbc4-3ea2-41d7-94c2-705974e71da9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:01.174068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2944dd0-61af-4a6f-b801-35a4c4a88cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:01.174663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2944dd0-61af-4a6f-b801-35a4c4a88cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:01.174941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2944dd0-61af-4a6f-b801-35a4c4a88cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:01.175210 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2944dd0-61af-4a6f-b801-35a4c4a88cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:01.184042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2944dd0-61af-4a6f-b801-35a4c4a88cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:01.185458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2944dd0-61af-4a6f-b801-35a4c4a88cb8 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:01.194733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1354/2701] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:01.456798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17c31b-d2f6-4d3f-bad5-9c46bbe0051f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:01.458358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ba17c31b-d2f6-4d3f-bad5-9c46bbe0051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:01.471192 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17c31b-d2f6-4d3f-bad5-9c46bbe0051f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:01.475813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:01.476445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:01.476728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:01.477058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] PATH_INFO: `/v3/projects/6efc4709fde54c07bf75cfbe8de52aeb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:01.478168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6efc4709fde54c07bf75cfbe8de52aeb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:01.480062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:01.520714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:01.528945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6efc4709fde54c07bf75cfbe8de52aeb', 'request_id': 'req-26284fd6-231d-43b8-be6b-8b5f15dce949'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.536067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6efc4709fde54c07bf75cfbe8de52aeb', 'request_id': 'req-26284fd6-231d-43b8-be6b-8b5f15dce949'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.541700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6efc4709fde54c07bf75cfbe8de52aeb', 'request_id': 'req-26284fd6-231d-43b8-be6b-8b5f15dce949'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.552798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] The token cache is being invalidate because project 6efc4709fde54c07bf75cfbe8de52aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:21:01.553095 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.553755 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.555227 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1348/2702] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:21:01 2022] DELETE /identity/v3/projects/6efc4709fde54c07bf75cfbe8de52aeb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:21:01.559218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2944dd0-61af-4a6f-b801-35a4c4a88cb8 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:01.569602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2944dd0-61af-4a6f-b801-35a4c4a88cb8 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:01.608834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:01.627190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:01.627927 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:01.628207 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:01.628475 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] PATH_INFO: `/v3/users/d051759aae814761981e0e32b3c31b93` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:01.629577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d051759aae814761981e0e32b3c31b93)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:01.631513 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:01.676654 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd051759aae814761981e0e32b3c31b93'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.684193 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd051759aae814761981e0e32b3c31b93'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.684806 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd051759aae814761981e0e32b3c31b93'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.685969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd051759aae814761981e0e32b3c31b93'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.693068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd051759aae814761981e0e32b3c31b93'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:01.712352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1355/2703] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:21:01 2022] DELETE /identity/v3/users/d051759aae814761981e0e32b3c31b93 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:02.007539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:02.009025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:02.021534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26284fd6-231d-43b8-be6b-8b5f15dce949 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:02.075728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:02.077189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:02.077189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:02.077460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] PATH_INFO: `/v3/projects/9523206d588e42b1afdd177e48b41137` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:02.078544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9523206d588e42b1afdd177e48b41137)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:02.080419 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:02.128949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9523206d588e42b1afdd177e48b41137', 'request_id': 'req-29673b60-89e9-4bef-9163-7a0381a3b498'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.136488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9523206d588e42b1afdd177e48b41137', 'request_id': 'req-29673b60-89e9-4bef-9163-7a0381a3b498'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.143237 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9523206d588e42b1afdd177e48b41137', 'request_id': 'req-29673b60-89e9-4bef-9163-7a0381a3b498'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.154455 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] The token cache is being invalidate because project 9523206d588e42b1afdd177e48b41137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:21:02.154953 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.155598 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.157075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1349/2704] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:21:02 2022] DELETE /identity/v3/projects/9523206d588e42b1afdd177e48b41137 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:02.161234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:02.162687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:02.176486 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cc1c1-7630-4483-810b-19f8f22ff5c5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:02.232840 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:02.233392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:02.233699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:02.233977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] PATH_INFO: `/v3/users/3be04ec500b842f3bad27f7b62013e16` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:02.235351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be04ec500b842f3bad27f7b62013e16)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:02.237253 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:02.282633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be04ec500b842f3bad27f7b62013e16'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.290040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be04ec500b842f3bad27f7b62013e16'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.290831 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be04ec500b842f3bad27f7b62013e16'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.291467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be04ec500b842f3bad27f7b62013e16'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.298315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e4d64a3a-fdb7-4c56-8abb-6848edf18a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be04ec500b842f3bad27f7b62013e16'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.299401 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:02.318281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1356/2705] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:21:02 2022] DELETE /identity/v3/users/3be04ec500b842f3bad27f7b62013e16 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:02.779081 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:02.781250 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:02.793776 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29673b60-89e9-4bef-9163-7a0381a3b498 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:02.850965 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:02.858941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:02.859652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:02.860639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:02.861229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] PATH_INFO: `/v3/projects/2b2e99ece64c43a79922c17e535f9e28` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:02.862808 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2e99ece64c43a79922c17e535f9e28)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:02.864966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:02.912193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2e99ece64c43a79922c17e535f9e28', 'request_id': 'req-20b1470e-a80c-418f-900f-0addcf56ace0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.919665 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2e99ece64c43a79922c17e535f9e28', 'request_id': 'req-20b1470e-a80c-418f-900f-0addcf56ace0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.926038 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2e99ece64c43a79922c17e535f9e28', 'request_id': 'req-20b1470e-a80c-418f-900f-0addcf56ace0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.937551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] The token cache is being invalidate because project 2b2e99ece64c43a79922c17e535f9e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:21:02.937870 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.938954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-20b1470e-a80c-418f-900f-0addcf56ace0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:02.940413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1350/2706] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:21:02 2022] DELETE /identity/v3/projects/2b2e99ece64c43a79922c17e535f9e28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:02.946553 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2660aa4-e586-4598-a8cb-d923012d9fa8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:02.946897 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2660aa4-e586-4598-a8cb-d923012d9fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:02.947182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2660aa4-e586-4598-a8cb-d923012d9fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:02.968185 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f2660aa4-e586-4598-a8cb-d923012d9fa8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:02.969494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f2660aa4-e586-4598-a8cb-d923012d9fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:03.035016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1357/2707] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:03.043151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee3d9-f9c7-4d66-b5f2-29e55f58ea36 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.043430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee3d9-f9c7-4d66-b5f2-29e55f58ea36 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.043707 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee3d9-f9c7-4d66-b5f2-29e55f58ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.063990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-842ee3d9-f9c7-4d66-b5f2-29e55f58ea36 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:03.065193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-842ee3d9-f9c7-4d66-b5f2-29e55f58ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:03.074540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1351/2708] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:03.079469 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2660aa4-e586-4598-a8cb-d923012d9fa8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.090369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2660aa4-e586-4598-a8cb-d923012d9fa8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:03.095612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac28a3-57e0-45e5-8825-e46ae94779aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:03.096220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac28a3-57e0-45e5-8825-e46ae94779aa admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.096499 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac28a3-57e0-45e5-8825-e46ae94779aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.096768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac28a3-57e0-45e5-8825-e46ae94779aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.097410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac28a3-57e0-45e5-8825-e46ae94779aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:21:03.097744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac28a3-57e0-45e5-8825-e46ae94779aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:03.099462 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac28a3-57e0-45e5-8825-e46ae94779aa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:03.111712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1358/2709] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:21:03.116248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee3d9-f9c7-4d66-b5f2-29e55f58ea36 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.126409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee3d9-f9c7-4d66-b5f2-29e55f58ea36 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:03.131335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b3e79-b94f-4e14-ae7a-b546c3dbb8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:03.131961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3e79-b94f-4e14-ae7a-b546c3dbb8dd admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.132245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3e79-b94f-4e14-ae7a-b546c3dbb8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.132532 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3e79-b94f-4e14-ae7a-b546c3dbb8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.133260 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b3e79-b94f-4e14-ae7a-b546c3dbb8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:03.135161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b3e79-b94f-4e14-ae7a-b546c3dbb8dd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:03.182460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1352/2710] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:21:03 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:21:03.187235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac28a3-57e0-45e5-8825-e46ae94779aa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.197225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac28a3-57e0-45e5-8825-e46ae94779aa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:03.258405 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f218e-1306-4868-bd66-26ff6c468ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:03.259023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f218e-1306-4868-bd66-26ff6c468ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.259305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f218e-1306-4868-bd66-26ff6c468ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.259581 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f218e-1306-4868-bd66-26ff6c468ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.260215 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f218e-1306-4868-bd66-26ff6c468ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:03.262217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f218e-1306-4868-bd66-26ff6c468ed1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:03.288044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1359/2711] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:21:03 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:21:03.289363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b3e79-b94f-4e14-ae7a-b546c3dbb8dd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.300198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b3e79-b94f-4e14-ae7a-b546c3dbb8dd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:03.304797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba12166-b349-4688-b16a-189b511ddf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:03.305400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba12166-b349-4688-b16a-189b511ddf27 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.306130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba12166-b349-4688-b16a-189b511ddf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.306130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba12166-b349-4688-b16a-189b511ddf27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.306620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba12166-b349-4688-b16a-189b511ddf27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:03.308190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba12166-b349-4688-b16a-189b511ddf27 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:03.318876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1353/2712] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:21:03.322830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f218e-1306-4868-bd66-26ff6c468ed1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.332944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f218e-1306-4868-bd66-26ff6c468ed1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:03.337786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d869e1-a106-4b58-8f81-3cb484ee9043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:03.338385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d869e1-a106-4b58-8f81-3cb484ee9043 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.338690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d869e1-a106-4b58-8f81-3cb484ee9043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.338960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d869e1-a106-4b58-8f81-3cb484ee9043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.339603 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d869e1-a106-4b58-8f81-3cb484ee9043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:03.341199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d869e1-a106-4b58-8f81-3cb484ee9043 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:03.353153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1360/2713] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:21:03.357860 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba12166-b349-4688-b16a-189b511ddf27 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.380511 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba12166-b349-4688-b16a-189b511ddf27 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:03.385424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0118a-c8c3-4734-a054-509e930f28bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:03.386233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0118a-c8c3-4734-a054-509e930f28bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.386558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0118a-c8c3-4734-a054-509e930f28bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.386795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0118a-c8c3-4734-a054-509e930f28bd admin admin] PATH_INFO: `/v3/projects/b732eecd1e5046cd834de1398eb99337/users/d5dc047868e5447895c9263737a1cbdc/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.402381 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0118a-c8c3-4734-a054-509e930f28bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b732eecd1e5046cd834de1398eb99337, user_id=d5dc047868e5447895c9263737a1cbdc, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:03.405100 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0118a-c8c3-4734-a054-509e930f28bd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:03.439360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1354/2714] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:21:03 2022] PUT /identity/v3/projects/b732eecd1e5046cd834de1398eb99337/users/d5dc047868e5447895c9263737a1cbdc/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:21:03.442891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a014f5-14cb-40af-b47f-0f2901556964 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.443176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a014f5-14cb-40af-b47f-0f2901556964 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.443449 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a014f5-14cb-40af-b47f-0f2901556964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.481517 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-20a014f5-14cb-40af-b47f-0f2901556964 None None] MFA Rules not processed for user `d5dc047868e5447895c9263737a1cbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:03.484470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-20a014f5-14cb-40af-b47f-0f2901556964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:03.542754 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:03.588736 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1361/2715] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:03.589919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0118a-c8c3-4734-a054-509e930f28bd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.691576 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0118a-c8c3-4734-a054-509e930f28bd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:03.696473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb753c28-dd2d-42cd-baad-0d0d8588e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:03.697107 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb753c28-dd2d-42cd-baad-0d0d8588e144 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.697390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb753c28-dd2d-42cd-baad-0d0d8588e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.697704 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb753c28-dd2d-42cd-baad-0d0d8588e144 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.698357 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb753c28-dd2d-42cd-baad-0d0d8588e144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:03.700312 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb753c28-dd2d-42cd-baad-0d0d8588e144 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:03.730478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1355/2716] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:21:03 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:21:03.736236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a014f5-14cb-40af-b47f-0f2901556964 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.747114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a014f5-14cb-40af-b47f-0f2901556964 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:03.805154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40348fc-d0ef-4c99-a7c2-606eabe41e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:03.805799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40348fc-d0ef-4c99-a7c2-606eabe41e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.806078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40348fc-d0ef-4c99-a7c2-606eabe41e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.806354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40348fc-d0ef-4c99-a7c2-606eabe41e24 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.807000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40348fc-d0ef-4c99-a7c2-606eabe41e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:03.808898 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40348fc-d0ef-4c99-a7c2-606eabe41e24 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:03.830132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1362/2717] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:21:03 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:21:03.834222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb753c28-dd2d-42cd-baad-0d0d8588e144 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.845304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb753c28-dd2d-42cd-baad-0d0d8588e144 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:03.850050 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b0fc4-2909-4314-9cba-0828c38354ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:03.850724 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b0fc4-2909-4314-9cba-0828c38354ec admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.851440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b0fc4-2909-4314-9cba-0828c38354ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.851440 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b0fc4-2909-4314-9cba-0828c38354ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.851963 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b0fc4-2909-4314-9cba-0828c38354ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:03.853557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b0fc4-2909-4314-9cba-0828c38354ec admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:03.856229 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:03.871084 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1356/2718] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:21:03.872296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40348fc-d0ef-4c99-a7c2-606eabe41e24 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.882561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40348fc-d0ef-4c99-a7c2-606eabe41e24 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:03.887161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ede95-e028-4316-9e4c-7ec0818e41d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:03.887808 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ede95-e028-4316-9e4c-7ec0818e41d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:03.888088 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ede95-e028-4316-9e4c-7ec0818e41d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:03.888367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ede95-e028-4316-9e4c-7ec0818e41d0 admin admin] PATH_INFO: `/v3/projects/86e47feca8c8416fa320e85f9d1128d1/users/924a1efb228e4974a6540bb03ea07d3f/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:03.903466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ede95-e028-4316-9e4c-7ec0818e41d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e47feca8c8416fa320e85f9d1128d1, user_id=924a1efb228e4974a6540bb03ea07d3f, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:03.906691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ede95-e028-4316-9e4c-7ec0818e41d0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:03.923504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1363/2719] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:21:03 2022] PUT /identity/v3/projects/86e47feca8c8416fa320e85f9d1128d1/users/924a1efb228e4974a6540bb03ea07d3f/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:03.927679 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b0fc4-2909-4314-9cba-0828c38354ec admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:03.937934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b0fc4-2909-4314-9cba-0828c38354ec admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:04.010311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50200f-6b60-486e-b1f7-d41ef477820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:04.011119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50200f-6b60-486e-b1f7-d41ef477820f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:04.011409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50200f-6b60-486e-b1f7-d41ef477820f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:04.011685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50200f-6b60-486e-b1f7-d41ef477820f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:04.012338 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50200f-6b60-486e-b1f7-d41ef477820f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:04.014680 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50200f-6b60-486e-b1f7-d41ef477820f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:04.030409 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1357/2720] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:21:04.035022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ede95-e028-4316-9e4c-7ec0818e41d0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:04.048023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ede95-e028-4316-9e4c-7ec0818e41d0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:04.053614 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500db7-544d-4298-a412-3e4ede7b696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:04.054527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500db7-544d-4298-a412-3e4ede7b696a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:04.054937 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500db7-544d-4298-a412-3e4ede7b696a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:04.055267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500db7-544d-4298-a412-3e4ede7b696a admin admin] PATH_INFO: `/v3/projects/86e47feca8c8416fa320e85f9d1128d1/users/924a1efb228e4974a6540bb03ea07d3f/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:04.057334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38500db7-544d-4298-a412-3e4ede7b696a admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e47feca8c8416fa320e85f9d1128d1, user_id=924a1efb228e4974a6540bb03ea07d3f, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:04.060494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38500db7-544d-4298-a412-3e4ede7b696a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:04.077668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1364/2721] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:21:04 2022] PUT /identity/v3/projects/86e47feca8c8416fa320e85f9d1128d1/users/924a1efb228e4974a6540bb03ea07d3f/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:04.085904 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478048-8b7c-42e7-bc38-9c3d2202c89d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:04.086198 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478048-8b7c-42e7-bc38-9c3d2202c89d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:04.086465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478048-8b7c-42e7-bc38-9c3d2202c89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:04.123678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-da478048-8b7c-42e7-bc38-9c3d2202c89d None None] MFA Rules not processed for user `924a1efb228e4974a6540bb03ea07d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:04.124881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-da478048-8b7c-42e7-bc38-9c3d2202c89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:04.206347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1358/2722] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:04.214903 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500db7-544d-4298-a412-3e4ede7b696a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:04.216548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-38500db7-544d-4298-a412-3e4ede7b696a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:04.294458 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500db7-544d-4298-a412-3e4ede7b696a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:04.299717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b698-2500-4d35-b163-3a47fef7929f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:04.300341 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b698-2500-4d35-b163-3a47fef7929f service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:04.300620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b698-2500-4d35-b163-3a47fef7929f service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:04.300894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b698-2500-4d35-b163-3a47fef7929f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:04.310916 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18b698-2500-4d35-b163-3a47fef7929f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:04.312397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18b698-2500-4d35-b163-3a47fef7929f service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:04.323041 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1365/2723] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:04.941298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478048-8b7c-42e7-bc38-9c3d2202c89d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:05.004675 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478048-8b7c-42e7-bc38-9c3d2202c89d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:05.009491 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:05.010152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:05.010429 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:05.010700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] PATH_INFO: `/v3/users/d5dc047868e5447895c9263737a1cbdc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:05.011844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5dc047868e5447895c9263737a1cbdc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:05.014295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:05.037180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:05.065085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5dc047868e5447895c9263737a1cbdc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.072189 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5dc047868e5447895c9263737a1cbdc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.072950 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5dc047868e5447895c9263737a1cbdc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.073586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5dc047868e5447895c9263737a1cbdc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.081987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5dc047868e5447895c9263737a1cbdc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.101518 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1359/2724] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:21:04 2022] DELETE /identity/v3/users/d5dc047868e5447895c9263737a1cbdc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:05.106146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4783ca-730e-4baf-a3bc-448193777bf5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:05.106512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4783ca-730e-4baf-a3bc-448193777bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:05.106918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4783ca-730e-4baf-a3bc-448193777bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:05.128282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4f4783ca-730e-4baf-a3bc-448193777bf5 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:05.129533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4f4783ca-730e-4baf-a3bc-448193777bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:05.157964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:05.196836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1366/2725] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:21:05.207639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:05.209428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:05.271115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e02be1-4585-4937-85aa-cc11c6d58a41 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:05.274815 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d4d73-e076-4f61-a85f-dfe0400cbcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:05.275427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d4d73-e076-4f61-a85f-dfe0400cbcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:05.275710 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d4d73-e076-4f61-a85f-dfe0400cbcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:05.275988 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d4d73-e076-4f61-a85f-dfe0400cbcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:05.286145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d4d73-e076-4f61-a85f-dfe0400cbcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:05.287608 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d4d73-e076-4f61-a85f-dfe0400cbcc2 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:05.300649 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1360/2726] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:05.585944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4783ca-730e-4baf-a3bc-448193777bf5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:05.587598 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4f4783ca-730e-4baf-a3bc-448193777bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:05.600977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4783ca-730e-4baf-a3bc-448193777bf5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:05.605944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:05.606633 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:05.607032 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:05.608043 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] PATH_INFO: `/v3/projects/b732eecd1e5046cd834de1398eb99337` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:05.609329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b732eecd1e5046cd834de1398eb99337)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:05.611584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:05.660933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b732eecd1e5046cd834de1398eb99337', 'request_id': 'req-07d5b2bf-6377-4f03-a708-b248f06a1315'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.666493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b732eecd1e5046cd834de1398eb99337', 'request_id': 'req-07d5b2bf-6377-4f03-a708-b248f06a1315'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.674965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b732eecd1e5046cd834de1398eb99337', 'request_id': 'req-07d5b2bf-6377-4f03-a708-b248f06a1315'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.687179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] The token cache is being invalidate because project b732eecd1e5046cd834de1398eb99337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:21:05.687503 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.688154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.689642 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1367/2727] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:21:05 2022] DELETE /identity/v3/projects/b732eecd1e5046cd834de1398eb99337 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:05.693853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d4d73-e076-4f61-a85f-dfe0400cbcc2 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:05.705079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d4d73-e076-4f61-a85f-dfe0400cbcc2 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:05.768045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:05.768751 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:05.769031 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:05.769302 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] PATH_INFO: `/v3/users/924a1efb228e4974a6540bb03ea07d3f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:05.770515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=924a1efb228e4974a6540bb03ea07d3f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:05.772505 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:05.815526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:05.818610 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924a1efb228e4974a6540bb03ea07d3f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.828047 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924a1efb228e4974a6540bb03ea07d3f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.828693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924a1efb228e4974a6540bb03ea07d3f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.829320 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924a1efb228e4974a6540bb03ea07d3f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.836367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6928f4de-52ae-4f45-9c06-7b7dbbb087ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924a1efb228e4974a6540bb03ea07d3f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:05.853316 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1361/2728] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:21:05 2022] DELETE /identity/v3/users/924a1efb228e4974a6540bb03ea07d3f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:06.130799 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:06.132239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:06.146613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5b2bf-6377-4f03-a708-b248f06a1315 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:06.210249 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:06.210876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.211157 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.211423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] PATH_INFO: `/v3/projects/86e47feca8c8416fa320e85f9d1128d1` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.212533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e47feca8c8416fa320e85f9d1128d1)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:06.214457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:06.259870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e47feca8c8416fa320e85f9d1128d1', 'request_id': 'req-af642919-def5-453e-9951-a9ac1a034455'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:06.264800 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:06.266176 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e47feca8c8416fa320e85f9d1128d1', 'request_id': 'req-af642919-def5-453e-9951-a9ac1a034455'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:06.274150 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e47feca8c8416fa320e85f9d1128d1', 'request_id': 'req-af642919-def5-453e-9951-a9ac1a034455'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:06.285830 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] The token cache is being invalidate because project 86e47feca8c8416fa320e85f9d1128d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:21:06.286115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:06.286731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-af642919-def5-453e-9951-a9ac1a034455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:06.288179 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1368/2729] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:21:06 2022] DELETE /identity/v3/projects/86e47feca8c8416fa320e85f9d1128d1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:06.293369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d29524-05ec-403c-baf5-3e20d162b712 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.293890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d29524-05ec-403c-baf5-3e20d162b712 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.293995 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d29524-05ec-403c-baf5-3e20d162b712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.314200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-04d29524-05ec-403c-baf5-3e20d162b712 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:06.315383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-04d29524-05ec-403c-baf5-3e20d162b712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:06.374956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1362/2730] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:06.382955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c717191-50db-466a-ac6b-b026411bd324 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.383239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c717191-50db-466a-ac6b-b026411bd324 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.383512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c717191-50db-466a-ac6b-b026411bd324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.403760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0c717191-50db-466a-ac6b-b026411bd324 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:06.404981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0c717191-50db-466a-ac6b-b026411bd324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:06.412834 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1369/2731] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:06.417118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d29524-05ec-403c-baf5-3e20d162b712 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:06.427263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d29524-05ec-403c-baf5-3e20d162b712 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:06.431772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f349cf-04d9-43d8-b063-00950bf716ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:06.432363 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f349cf-04d9-43d8-b063-00950bf716ee admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.432638 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f349cf-04d9-43d8-b063-00950bf716ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.432903 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f349cf-04d9-43d8-b063-00950bf716ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.433547 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f349cf-04d9-43d8-b063-00950bf716ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:21:06.433862 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f349cf-04d9-43d8-b063-00950bf716ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:06.436061 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f349cf-04d9-43d8-b063-00950bf716ee admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:06.448610 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1363/2732] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:21:06.453368 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c717191-50db-466a-ac6b-b026411bd324 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:06.463578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c717191-50db-466a-ac6b-b026411bd324 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:06.468710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724e93d-a236-44ba-9d1a-0a59a9e0fcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:06.469338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724e93d-a236-44ba-9d1a-0a59a9e0fcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.469640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724e93d-a236-44ba-9d1a-0a59a9e0fcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.469919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724e93d-a236-44ba-9d1a-0a59a9e0fcc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.470551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724e93d-a236-44ba-9d1a-0a59a9e0fcc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:06.472433 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724e93d-a236-44ba-9d1a-0a59a9e0fcc7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:06.501174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1370/2733] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:21:06 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:21:06.504715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f349cf-04d9-43d8-b063-00950bf716ee admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:06.515017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f349cf-04d9-43d8-b063-00950bf716ee admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:06.578081 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d70058-280b-4c91-ab2c-ad247f9fce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:06.578696 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d70058-280b-4c91-ab2c-ad247f9fce0a admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.578972 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d70058-280b-4c91-ab2c-ad247f9fce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.579536 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d70058-280b-4c91-ab2c-ad247f9fce0a admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.580028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d70058-280b-4c91-ab2c-ad247f9fce0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:06.582020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d70058-280b-4c91-ab2c-ad247f9fce0a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:06.603482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1364/2734] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:21:06 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:21:06.614883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724e93d-a236-44ba-9d1a-0a59a9e0fcc7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:06.622493 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724e93d-a236-44ba-9d1a-0a59a9e0fcc7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:06.627883 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54080cb4-a7b7-425d-a257-edab7ffe758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:06.628426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54080cb4-a7b7-425d-a257-edab7ffe758f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.628705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54080cb4-a7b7-425d-a257-edab7ffe758f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.629006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54080cb4-a7b7-425d-a257-edab7ffe758f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.629681 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54080cb4-a7b7-425d-a257-edab7ffe758f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:06.631265 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54080cb4-a7b7-425d-a257-edab7ffe758f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:06.642074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1371/2735] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:21:06.646249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d70058-280b-4c91-ab2c-ad247f9fce0a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:06.656791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d70058-280b-4c91-ab2c-ad247f9fce0a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:06.666721 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79133e-611b-4739-9ab5-34d63b7c8fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:06.671151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79133e-611b-4739-9ab5-34d63b7c8fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.671151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79133e-611b-4739-9ab5-34d63b7c8fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.671151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79133e-611b-4739-9ab5-34d63b7c8fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.671151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79133e-611b-4739-9ab5-34d63b7c8fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:06.671577 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79133e-611b-4739-9ab5-34d63b7c8fe3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:06.696831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1365/2736] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:21:06.701717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54080cb4-a7b7-425d-a257-edab7ffe758f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:06.717190 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54080cb4-a7b7-425d-a257-edab7ffe758f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:06.727879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d18e0-619b-46e8-b6ca-64899d4cea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:06.728687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d18e0-619b-46e8-b6ca-64899d4cea6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.729067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d18e0-619b-46e8-b6ca-64899d4cea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.729430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d18e0-619b-46e8-b6ca-64899d4cea6b admin admin] PATH_INFO: `/v3/projects/29ad5c0935e84b6782bb722c9cfdefad/users/fc43d6924d33463495be3645010e1575/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.745255 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d18e0-619b-46e8-b6ca-64899d4cea6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ad5c0935e84b6782bb722c9cfdefad, user_id=fc43d6924d33463495be3645010e1575, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:06.748501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d18e0-619b-46e8-b6ca-64899d4cea6b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:06.761320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1372/2737] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:21:06 2022] PUT /identity/v3/projects/29ad5c0935e84b6782bb722c9cfdefad/users/fc43d6924d33463495be3645010e1575/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:06.767099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7523900-4dec-4242-a63e-6195a3e59eb9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.767494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7523900-4dec-4242-a63e-6195a3e59eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.767844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7523900-4dec-4242-a63e-6195a3e59eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.787053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c7523900-4dec-4242-a63e-6195a3e59eb9 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:06.788248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c7523900-4dec-4242-a63e-6195a3e59eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:06.808944 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:06.850628 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1366/2738] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:21:06.862017 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d18e0-619b-46e8-b6ca-64899d4cea6b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:06.864092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-da4d18e0-619b-46e8-b6ca-64899d4cea6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:06.923187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d18e0-619b-46e8-b6ca-64899d4cea6b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:06.926859 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ea41-32bd-4d6f-a73d-09bcd2f4c829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:06.927462 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ea41-32bd-4d6f-a73d-09bcd2f4c829 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:06.927740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ea41-32bd-4d6f-a73d-09bcd2f4c829 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:06.928013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ea41-32bd-4d6f-a73d-09bcd2f4c829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:06.938189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94ea41-32bd-4d6f-a73d-09bcd2f4c829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:06.939611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94ea41-32bd-4d6f-a73d-09bcd2f4c829 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:06.949039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1373/2739] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:07.566494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e1c78-9e97-4c9b-a808-3ac7f65d832c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:07.567027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e1c78-9e97-4c9b-a808-3ac7f65d832c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:07.567177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e1c78-9e97-4c9b-a808-3ac7f65d832c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:07.596130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5a0e1c78-9e97-4c9b-a808-3ac7f65d832c None None] MFA Rules not processed for user `fc43d6924d33463495be3645010e1575`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:07.597453 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5a0e1c78-9e97-4c9b-a808-3ac7f65d832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:07.672214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1367/2740] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:07.683481 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ea41-32bd-4d6f-a73d-09bcd2f4c829 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:07.684918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e94ea41-32bd-4d6f-a73d-09bcd2f4c829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:07.746275 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ea41-32bd-4d6f-a73d-09bcd2f4c829 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:07.750977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222e998-bc4e-4c5e-adeb-3ca467afe874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:07.751687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222e998-bc4e-4c5e-adeb-3ca467afe874 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:07.752045 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222e998-bc4e-4c5e-adeb-3ca467afe874 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:07.752382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222e998-bc4e-4c5e-adeb-3ca467afe874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:07.761376 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222e998-bc4e-4c5e-adeb-3ca467afe874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:07.763053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222e998-bc4e-4c5e-adeb-3ca467afe874 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:07.772585 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1374/2741] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:07.834918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e1c78-9e97-4c9b-a808-3ac7f65d832c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:07.844712 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e1c78-9e97-4c9b-a808-3ac7f65d832c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:07.848367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fab233-757b-4ef8-9820-8fcb5784ba41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:07.848967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fab233-757b-4ef8-9820-8fcb5784ba41 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:07.849420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fab233-757b-4ef8-9820-8fcb5784ba41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:07.849519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fab233-757b-4ef8-9820-8fcb5784ba41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:07.851278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-22fab233-757b-4ef8-9820-8fcb5784ba41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:07.864660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fab233-757b-4ef8-9820-8fcb5784ba41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:07.866294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fab233-757b-4ef8-9820-8fcb5784ba41 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:07.876920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1368/2742] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:09.150569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619e855-7980-4896-a302-316527af1e66 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:09.151092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619e855-7980-4896-a302-316527af1e66 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:09.151193 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619e855-7980-4896-a302-316527af1e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:09.171548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e619e855-7980-4896-a302-316527af1e66 None None] MFA Rules not processed for user `fc43d6924d33463495be3645010e1575`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:09.172767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e619e855-7980-4896-a302-316527af1e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:09.179750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1375/2743] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:10.999297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fab233-757b-4ef8-9820-8fcb5784ba41 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:11.006478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-22fab233-757b-4ef8-9820-8fcb5784ba41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:11.020364 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fab233-757b-4ef8-9820-8fcb5784ba41 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:11.025890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:11.026562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.026848 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.027118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] PATH_INFO: `/v3/users/2bb68c40e4964cb0b3d74fdf9d91cb2c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.028554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb68c40e4964cb0b3d74fdf9d91cb2c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:11.031930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:11.112554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb68c40e4964cb0b3d74fdf9d91cb2c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:11.121466 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb68c40e4964cb0b3d74fdf9d91cb2c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:11.122106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb68c40e4964cb0b3d74fdf9d91cb2c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:11.122741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb68c40e4964cb0b3d74fdf9d91cb2c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:11.130487 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49b6a154-4d07-4e00-a46c-a87c6c48d621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb68c40e4964cb0b3d74fdf9d91cb2c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:11.148181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1369/2744] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:21:10 2022] DELETE /identity/v3/users/2bb68c40e4964cb0b3d74fdf9d91cb2c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:11.330297 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619e855-7980-4896-a302-316527af1e66 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:11.348569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619e855-7980-4896-a302-316527af1e66 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:11.376070 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:11.420369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:11.421187 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.421470 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.421791 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] PATH_INFO: `/v3/projects/07ae5faab0ea45f2853b3569642e90c2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.422980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ae5faab0ea45f2853b3569642e90c2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:11.424889 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:11.474284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ae5faab0ea45f2853b3569642e90c2', 'request_id': 'req-2e803133-8feb-40bb-b038-5830239f7147'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:11.481386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ae5faab0ea45f2853b3569642e90c2', 'request_id': 'req-2e803133-8feb-40bb-b038-5830239f7147'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:11.490348 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ae5faab0ea45f2853b3569642e90c2', 'request_id': 'req-2e803133-8feb-40bb-b038-5830239f7147'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:11.501648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] The token cache is being invalidate because project 07ae5faab0ea45f2853b3569642e90c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:21:11.501947 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:11.502586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e803133-8feb-40bb-b038-5830239f7147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:21:11.504067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1376/2745] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:21:11 2022] DELETE /identity/v3/projects/07ae5faab0ea45f2853b3569642e90c2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:21:11.509573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6d15-e6e8-4044-88ba-abef0d47ccc9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.509949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6d15-e6e8-4044-88ba-abef0d47ccc9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.510321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6d15-e6e8-4044-88ba-abef0d47ccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.531714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-81bc6d15-e6e8-4044-88ba-abef0d47ccc9 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:11.532931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-81bc6d15-e6e8-4044-88ba-abef0d47ccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:11.542346 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:11.603753 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1370/2746] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:21:11.605381 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227d9c-b76b-4062-a8c7-b8681bae8d44 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.605917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227d9c-b76b-4062-a8c7-b8681bae8d44 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.606103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227d9c-b76b-4062-a8c7-b8681bae8d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.628237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d8227d9c-b76b-4062-a8c7-b8681bae8d44 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:11.629520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d8227d9c-b76b-4062-a8c7-b8681bae8d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:11.642148 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1377/2747] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:21:11.643406 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc6d15-e6e8-4044-88ba-abef0d47ccc9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:11.653267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc6d15-e6e8-4044-88ba-abef0d47ccc9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:11.659030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc005-9bd3-446e-ba6a-de18af57522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:11.659678 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc005-9bd3-446e-ba6a-de18af57522e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.659962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc005-9bd3-446e-ba6a-de18af57522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.660362 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc005-9bd3-446e-ba6a-de18af57522e admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.661020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefc005-9bd3-446e-ba6a-de18af57522e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:21:11.661328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefc005-9bd3-446e-ba6a-de18af57522e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:11.662959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefc005-9bd3-446e-ba6a-de18af57522e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:11.676115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1371/2748] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:21:11.680732 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8227d9c-b76b-4062-a8c7-b8681bae8d44 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:11.690220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8227d9c-b76b-4062-a8c7-b8681bae8d44 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:11.694900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dab43d-2f5d-448a-a653-eca3bf1f5273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:11.695496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dab43d-2f5d-448a-a653-eca3bf1f5273 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.695773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dab43d-2f5d-448a-a653-eca3bf1f5273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.696044 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dab43d-2f5d-448a-a653-eca3bf1f5273 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.696668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dab43d-2f5d-448a-a653-eca3bf1f5273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:11.698573 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dab43d-2f5d-448a-a653-eca3bf1f5273 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:11.727084 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1378/2749] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:21:11 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:21:11.731289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc005-9bd3-446e-ba6a-de18af57522e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:11.741994 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc005-9bd3-446e-ba6a-de18af57522e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:11.802785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d3eac-a3c9-4469-acfa-ba550a2afcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:11.803319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d3eac-a3c9-4469-acfa-ba550a2afcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.803603 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d3eac-a3c9-4469-acfa-ba550a2afcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.803879 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d3eac-a3c9-4469-acfa-ba550a2afcd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.804510 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d3eac-a3c9-4469-acfa-ba550a2afcd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:11.806456 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d3eac-a3c9-4469-acfa-ba550a2afcd3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:11.828724 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1372/2750] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:21:11 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:21:11.833078 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dab43d-2f5d-448a-a653-eca3bf1f5273 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:11.844862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dab43d-2f5d-448a-a653-eca3bf1f5273 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:11.849550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85286ff-e06f-4356-be37-a49fca7c4d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:11.850180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85286ff-e06f-4356-be37-a49fca7c4d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.850462 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85286ff-e06f-4356-be37-a49fca7c4d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.850737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85286ff-e06f-4356-be37-a49fca7c4d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.851408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85286ff-e06f-4356-be37-a49fca7c4d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:11.853000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85286ff-e06f-4356-be37-a49fca7c4d9a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:11.863344 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1379/2751] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:21:11.867504 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d3eac-a3c9-4469-acfa-ba550a2afcd3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:11.878935 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d3eac-a3c9-4469-acfa-ba550a2afcd3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:11.883748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6c7c-6dcd-4b48-97fc-e88a1ed94fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:11.884356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6c7c-6dcd-4b48-97fc-e88a1ed94fef admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.884640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6c7c-6dcd-4b48-97fc-e88a1ed94fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.884916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6c7c-6dcd-4b48-97fc-e88a1ed94fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.885558 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6c7c-6dcd-4b48-97fc-e88a1ed94fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:11.887180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6c7c-6dcd-4b48-97fc-e88a1ed94fef admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:11.900347 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1373/2752] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:21:11.904637 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85286ff-e06f-4356-be37-a49fca7c4d9a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:11.914753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85286ff-e06f-4356-be37-a49fca7c4d9a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:11.919648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b00b18-6bda-42c7-8ab0-007d2649ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:11.920437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b00b18-6bda-42c7-8ab0-007d2649ba10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.920716 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b00b18-6bda-42c7-8ab0-007d2649ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.920990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b00b18-6bda-42c7-8ab0-007d2649ba10 admin admin] PATH_INFO: `/v3/projects/d9969a02aac342e3846ec2425fbc4199/users/eb360cd46a5c40dfa11e6d72bbaa47bc/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.936662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b00b18-6bda-42c7-8ab0-007d2649ba10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9969a02aac342e3846ec2425fbc4199, user_id=eb360cd46a5c40dfa11e6d72bbaa47bc, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:11.939346 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b00b18-6bda-42c7-8ab0-007d2649ba10 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:11.955450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1380/2753] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:21:11 2022] PUT /identity/v3/projects/d9969a02aac342e3846ec2425fbc4199/users/eb360cd46a5c40dfa11e6d72bbaa47bc/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:21:11.960617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08d72-5cbf-44f6-acde-d0e7dc3321c4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:11.961027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08d72-5cbf-44f6-acde-d0e7dc3321c4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:11.961333 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08d72-5cbf-44f6-acde-d0e7dc3321c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:11.981062 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1de08d72-5cbf-44f6-acde-d0e7dc3321c4 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:11.982297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1de08d72-5cbf-44f6-acde-d0e7dc3321c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:12.052045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1374/2754] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:21:12.069042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b00b18-6bda-42c7-8ab0-007d2649ba10 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:12.071837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-41b00b18-6bda-42c7-8ab0-007d2649ba10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:12.158574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:12.166025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b00b18-6bda-42c7-8ab0-007d2649ba10 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:12.172489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e2c35-0592-45ab-af3e-a3a52a3ad531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:12.173423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e2c35-0592-45ab-af3e-a3a52a3ad531 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:12.174232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e2c35-0592-45ab-af3e-a3a52a3ad531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:12.174515 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e2c35-0592-45ab-af3e-a3a52a3ad531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:12.186392 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e2c35-0592-45ab-af3e-a3a52a3ad531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:12.188004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e2c35-0592-45ab-af3e-a3a52a3ad531 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:12.198424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1381/2755] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:17.143188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f4879-e1ed-4594-bec4-0b5a98ce16e4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:17.143693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f4879-e1ed-4594-bec4-0b5a98ce16e4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:17.143812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f4879-e1ed-4594-bec4-0b5a98ce16e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:17.176348 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e88f4879-e1ed-4594-bec4-0b5a98ce16e4 None None] MFA Rules not processed for user `eb360cd46a5c40dfa11e6d72bbaa47bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:17.177497 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e88f4879-e1ed-4594-bec4-0b5a98ce16e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:17.188699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:17.250103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1375/2756] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:21:17.264574 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e2c35-0592-45ab-af3e-a3a52a3ad531 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:17.266149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8b8e2c35-0592-45ab-af3e-a3a52a3ad531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:17.343007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e2c35-0592-45ab-af3e-a3a52a3ad531 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:17.348669 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5edae0-3639-470a-abd7-3f40ed18eb7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:17.349279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5edae0-3639-470a-abd7-3f40ed18eb7c service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:17.349560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5edae0-3639-470a-abd7-3f40ed18eb7c service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:17.349878 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5edae0-3639-470a-abd7-3f40ed18eb7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:17.358451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5edae0-3639-470a-abd7-3f40ed18eb7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:17.360278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5edae0-3639-470a-abd7-3f40ed18eb7c service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:17.369334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1382/2757] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:21:18.908982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f3d5-b081-49d6-977f-dea31a167ddc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:18.909499 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f3d5-b081-49d6-977f-dea31a167ddc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:18.909730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f3d5-b081-49d6-977f-dea31a167ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:18.929985 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c979f3d5-b081-49d6-977f-dea31a167ddc None None] MFA Rules not processed for user `eb360cd46a5c40dfa11e6d72bbaa47bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:18.931196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c979f3d5-b081-49d6-977f-dea31a167ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:18.938849 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1376/2758] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:21:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:27.365301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=39 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:28.924297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=25 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:41.889390 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7106-12c3-4283-8a83-b592a7103eed None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:41.889981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7106-12c3-4283-8a83-b592a7103eed None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:41.889981 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7106-12c3-4283-8a83-b592a7103eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:41.909867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d7ef7106-12c3-4283-8a83-b592a7103eed None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:41.911100 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d7ef7106-12c3-4283-8a83-b592a7103eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:41.919055 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1383/2759] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:41.939787 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f3d5-b081-49d6-977f-dea31a167ddc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:41.941159 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c979f3d5-b081-49d6-977f-dea31a167ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:41.956845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f3d5-b081-49d6-977f-dea31a167ddc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:41.962298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66547ee-cc45-41d7-8cc7-79ef1850d264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:41.962887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66547ee-cc45-41d7-8cc7-79ef1850d264 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:41.963164 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66547ee-cc45-41d7-8cc7-79ef1850d264 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:41.963435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66547ee-cc45-41d7-8cc7-79ef1850d264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:41.972028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66547ee-cc45-41d7-8cc7-79ef1850d264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:41.973596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66547ee-cc45-41d7-8cc7-79ef1850d264 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:41.983542 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1377/2760] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:45.987524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8c52-cad1-4c63-b3d1-24abf49c74cf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:45.988040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8c52-cad1-4c63-b3d1-24abf49c74cf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:45.988040 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8c52-cad1-4c63-b3d1-24abf49c74cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:46.014420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eb7a8c52-cad1-4c63-b3d1-24abf49c74cf None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:46.015610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eb7a8c52-cad1-4c63-b3d1-24abf49c74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:46.024559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1384/2761] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:46.046027 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66547ee-cc45-41d7-8cc7-79ef1850d264 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:46.057158 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66547ee-cc45-41d7-8cc7-79ef1850d264 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:46.063360 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213387a-be08-4ba6-8b35-687f60fa99dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:46.063945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213387a-be08-4ba6-8b35-687f60fa99dd service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:46.064223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213387a-be08-4ba6-8b35-687f60fa99dd service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:46.064495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213387a-be08-4ba6-8b35-687f60fa99dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:46.072605 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213387a-be08-4ba6-8b35-687f60fa99dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:46.074208 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213387a-be08-4ba6-8b35-687f60fa99dd service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:46.083738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1378/2762] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:21:49.241445 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8f167-beec-4e36-90ed-01db845e668f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:49.242031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8f167-beec-4e36-90ed-01db845e668f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:49.242031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8f167-beec-4e36-90ed-01db845e668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:49.261420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2ae8f167-beec-4e36-90ed-01db845e668f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:49.262645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2ae8f167-beec-4e36-90ed-01db845e668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:49.270396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1385/2763] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:49.292454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213387a-be08-4ba6-8b35-687f60fa99dd service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:49.304188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213387a-be08-4ba6-8b35-687f60fa99dd service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:49.310175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c23e90-6dc1-414a-9114-296118b44b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:49.310762 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c23e90-6dc1-414a-9114-296118b44b41 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:49.311037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c23e90-6dc1-414a-9114-296118b44b41 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:49.311304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c23e90-6dc1-414a-9114-296118b44b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:49.319293 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c23e90-6dc1-414a-9114-296118b44b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:49.320841 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c23e90-6dc1-414a-9114-296118b44b41 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:49.330008 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1379/2764] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:52.339333 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b3358-6246-4c97-a897-894dfa4e8af4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:52.339832 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b3358-6246-4c97-a897-894dfa4e8af4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:52.339960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b3358-6246-4c97-a897-894dfa4e8af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:52.361058 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e52b3358-6246-4c97-a897-894dfa4e8af4 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:52.362282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e52b3358-6246-4c97-a897-894dfa4e8af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:52.370023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1386/2765] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:52.392220 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c23e90-6dc1-414a-9114-296118b44b41 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:52.403156 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c23e90-6dc1-414a-9114-296118b44b41 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:52.408588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792d6d0-ea29-4e05-8457-973fcd029f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:52.409200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792d6d0-ea29-4e05-8457-973fcd029f22 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:52.409477 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792d6d0-ea29-4e05-8457-973fcd029f22 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:52.409784 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792d6d0-ea29-4e05-8457-973fcd029f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:52.417587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792d6d0-ea29-4e05-8457-973fcd029f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:52.419297 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792d6d0-ea29-4e05-8457-973fcd029f22 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:52.428442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1380/2766] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:56.532746 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c409a-c022-497c-9ac3-ccf8049105ec None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:56.533593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c409a-c022-497c-9ac3-ccf8049105ec None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:56.533844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c409a-c022-497c-9ac3-ccf8049105ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:56.553359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-910c409a-c022-497c-9ac3-ccf8049105ec None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:56.554578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-910c409a-c022-497c-9ac3-ccf8049105ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:56.563031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1387/2767] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:56.586533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792d6d0-ea29-4e05-8457-973fcd029f22 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:56.598076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792d6d0-ea29-4e05-8457-973fcd029f22 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:56.603524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c632e44-7ac4-4478-96c8-530e6e8ff027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:56.604145 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c632e44-7ac4-4478-96c8-530e6e8ff027 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:56.604413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c632e44-7ac4-4478-96c8-530e6e8ff027 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:56.604687 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c632e44-7ac4-4478-96c8-530e6e8ff027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:56.613526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c632e44-7ac4-4478-96c8-530e6e8ff027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:56.615109 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c632e44-7ac4-4478-96c8-530e6e8ff027 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:56.624937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1381/2768] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:21:59.712592 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578c4bd-3c8d-4f7d-8bcc-44f77f4d4c0b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:59.713180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578c4bd-3c8d-4f7d-8bcc-44f77f4d4c0b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:59.713180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578c4bd-3c8d-4f7d-8bcc-44f77f4d4c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:59.734839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a578c4bd-3c8d-4f7d-8bcc-44f77f4d4c0b None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:21:59.736305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a578c4bd-3c8d-4f7d-8bcc-44f77f4d4c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:21:59.744812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1388/2769] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:21:59.767135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c632e44-7ac4-4478-96c8-530e6e8ff027 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:21:59.778428 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c632e44-7ac4-4478-96c8-530e6e8ff027 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:21:59.783998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cde5c7-c4d9-4180-9d18-71f787449f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:21:59.784595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde5c7-c4d9-4180-9d18-71f787449f20 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:21:59.784874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde5c7-c4d9-4180-9d18-71f787449f20 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:21:59.785146 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde5c7-c4d9-4180-9d18-71f787449f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:21:59.794475 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cde5c7-c4d9-4180-9d18-71f787449f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:21:59.796036 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cde5c7-c4d9-4180-9d18-71f787449f20 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:21:59.805604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1382/2770] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:22:02.885740 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578c4bd-3c8d-4f7d-8bcc-44f77f4d4c0b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:22:02.887153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a578c4bd-3c8d-4f7d-8bcc-44f77f4d4c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:02.943406 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578c4bd-3c8d-4f7d-8bcc-44f77f4d4c0b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:22:02.946946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9016f-d5f1-44da-9eff-1ade3dc5118a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:22:02.947544 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9016f-d5f1-44da-9eff-1ade3dc5118a service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:02.947819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9016f-d5f1-44da-9eff-1ade3dc5118a service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:02.948090 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9016f-d5f1-44da-9eff-1ade3dc5118a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:02.949858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-60c9016f-d5f1-44da-9eff-1ade3dc5118a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:02.963749 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9016f-d5f1-44da-9eff-1ade3dc5118a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:22:02.965153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9016f-d5f1-44da-9eff-1ade3dc5118a service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:22:02.977184 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1389/2771] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:22:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:22:07.864188 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cde5c7-c4d9-4180-9d18-71f787449f20 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:22:07.865596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a8cde5c7-c4d9-4180-9d18-71f787449f20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:07.878329 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cde5c7-c4d9-4180-9d18-71f787449f20 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:22:07.882079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de8a64-49e0-4c2d-8f36-b04af77fba8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:22:07.882673 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de8a64-49e0-4c2d-8f36-b04af77fba8e service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:07.882956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de8a64-49e0-4c2d-8f36-b04af77fba8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:07.883224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de8a64-49e0-4c2d-8f36-b04af77fba8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:07.884931 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-17de8a64-49e0-4c2d-8f36-b04af77fba8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:07.898083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de8a64-49e0-4c2d-8f36-b04af77fba8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:22:07.899485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de8a64-49e0-4c2d-8f36-b04af77fba8e service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:22:07.910520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1383/2772] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:22:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:22:12.972395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=44 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:15.044531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055b8db-ad9e-4a4b-985d-db046727aee3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:15.045096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055b8db-ad9e-4a4b-985d-db046727aee3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:15.045096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055b8db-ad9e-4a4b-985d-db046727aee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:15.064174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5055b8db-ad9e-4a4b-985d-db046727aee3 None None] MFA Rules not processed for user `fc43d6924d33463495be3645010e1575`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:22:15.065352 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5055b8db-ad9e-4a4b-985d-db046727aee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:15.118757 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1390/2773] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:22:17.905435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=42 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:25.111999 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=25 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:29.015120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a056bc-e8c6-4069-8444-ec4ccb8ebf15 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:29.015718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a056bc-e8c6-4069-8444-ec4ccb8ebf15 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:29.015718 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a056bc-e8c6-4069-8444-ec4ccb8ebf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:29.034693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b9a056bc-e8c6-4069-8444-ec4ccb8ebf15 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:22:29.035889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b9a056bc-e8c6-4069-8444-ec4ccb8ebf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:29.044161 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1384/2774] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:22:29.064612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055b8db-ad9e-4a4b-985d-db046727aee3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:22:29.077688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055b8db-ad9e-4a4b-985d-db046727aee3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:22:29.083083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7dc0-2bab-4f39-994c-81de85a14a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:22:29.083687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7dc0-2bab-4f39-994c-81de85a14a94 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:29.083969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7dc0-2bab-4f39-994c-81de85a14a94 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:29.084245 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7dc0-2bab-4f39-994c-81de85a14a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:29.093046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc7dc0-2bab-4f39-994c-81de85a14a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:22:29.094660 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc7dc0-2bab-4f39-994c-81de85a14a94 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:22:29.103971 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1391/2775] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:22:32.280614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bcf8b-c089-45dd-bf5e-1667bd384bdb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:32.281166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bcf8b-c089-45dd-bf5e-1667bd384bdb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:32.281166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bcf8b-c089-45dd-bf5e-1667bd384bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:32.301182 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e08bcf8b-c089-45dd-bf5e-1667bd384bdb None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:22:32.302522 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e08bcf8b-c089-45dd-bf5e-1667bd384bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:32.310533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1385/2776] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:22:32.330867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7dc0-2bab-4f39-994c-81de85a14a94 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:22:32.343294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7dc0-2bab-4f39-994c-81de85a14a94 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:22:32.348797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966eabc2-ee84-459a-b928-340ddf3b11a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:22:32.349397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eabc2-ee84-459a-b928-340ddf3b11a2 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:32.349715 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eabc2-ee84-459a-b928-340ddf3b11a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:32.349993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eabc2-ee84-459a-b928-340ddf3b11a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:32.359182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966eabc2-ee84-459a-b928-340ddf3b11a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:22:32.361307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966eabc2-ee84-459a-b928-340ddf3b11a2 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:22:32.370860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1392/2777] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:22:35.360593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31871-26b8-4ea8-9245-a901d1fbd7ea None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:35.361147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31871-26b8-4ea8-9245-a901d1fbd7ea None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:35.361147 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31871-26b8-4ea8-9245-a901d1fbd7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:35.381103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bee31871-26b8-4ea8-9245-a901d1fbd7ea None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:22:35.382307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bee31871-26b8-4ea8-9245-a901d1fbd7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:35.390727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1386/2778] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:22:35.425452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966eabc2-ee84-459a-b928-340ddf3b11a2 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:22:35.437450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966eabc2-ee84-459a-b928-340ddf3b11a2 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:22:35.443025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeddd2f-4334-413b-9ff5-db8cd1adbe7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:22:35.443613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeddd2f-4334-413b-9ff5-db8cd1adbe7d service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:35.443893 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeddd2f-4334-413b-9ff5-db8cd1adbe7d service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:35.444171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeddd2f-4334-413b-9ff5-db8cd1adbe7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:35.453584 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeddd2f-4334-413b-9ff5-db8cd1adbe7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:22:35.455228 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeddd2f-4334-413b-9ff5-db8cd1adbe7d service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:22:35.465742 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1393/2779] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:22:38.517858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180a82d-06c1-4d2f-8987-0a837aaf0edc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:38.518365 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180a82d-06c1-4d2f-8987-0a837aaf0edc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:38.518484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180a82d-06c1-4d2f-8987-0a837aaf0edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:38.538264 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8180a82d-06c1-4d2f-8987-0a837aaf0edc None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:22:38.539454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8180a82d-06c1-4d2f-8987-0a837aaf0edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:38.548747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1387/2780] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:22:38.571009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeddd2f-4334-413b-9ff5-db8cd1adbe7d service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:22:38.583050 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeddd2f-4334-413b-9ff5-db8cd1adbe7d service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:22:38.588550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92239641-6c7c-45b2-bf99-ae618b7ff237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:22:38.589140 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92239641-6c7c-45b2-bf99-ae618b7ff237 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:38.589420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92239641-6c7c-45b2-bf99-ae618b7ff237 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:38.589887 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92239641-6c7c-45b2-bf99-ae618b7ff237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:38.599512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92239641-6c7c-45b2-bf99-ae618b7ff237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:22:38.602667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92239641-6c7c-45b2-bf99-ae618b7ff237 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:22:38.612606 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1394/2781] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:22:42.714991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698b27-c8bf-4295-822e-43f4e411d53c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:42.715473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698b27-c8bf-4295-822e-43f4e411d53c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:42.715589 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698b27-c8bf-4295-822e-43f4e411d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:42.736809 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a3698b27-c8bf-4295-822e-43f4e411d53c None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:22:42.738222 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a3698b27-c8bf-4295-822e-43f4e411d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:42.747733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1388/2782] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Sep 19 12:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:22:42.773775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92239641-6c7c-45b2-bf99-ae618b7ff237 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:22:42.786134 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92239641-6c7c-45b2-bf99-ae618b7ff237 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:22:42.791823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8029e1-cc5e-40eb-a134-9e7d33f611a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:22:42.792430 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8029e1-cc5e-40eb-a134-9e7d33f611a3 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:42.792706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8029e1-cc5e-40eb-a134-9e7d33f611a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:42.792977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8029e1-cc5e-40eb-a134-9e7d33f611a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:42.801389 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8029e1-cc5e-40eb-a134-9e7d33f611a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:22:42.803009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8029e1-cc5e-40eb-a134-9e7d33f611a3 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:22:42.813023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1395/2783] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:22:52.731887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=15 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:52.808193 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=30 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:53.542307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3698b27-c8bf-4295-822e-43f4e411d53c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:22:53.554548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3698b27-c8bf-4295-822e-43f4e411d53c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:22:53.559977 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589d2d6-4c67-4d4c-8b5b-eb4a795fd93a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:22:53.560568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589d2d6-4c67-4d4c-8b5b-eb4a795fd93a service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:53.560851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589d2d6-4c67-4d4c-8b5b-eb4a795fd93a service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:53.561119 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589d2d6-4c67-4d4c-8b5b-eb4a795fd93a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:53.562827 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c589d2d6-4c67-4d4c-8b5b-eb4a795fd93a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:53.574560 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589d2d6-4c67-4d4c-8b5b-eb4a795fd93a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:22:53.576749 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589d2d6-4c67-4d4c-8b5b-eb4a795fd93a service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:22:53.586961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1389/2784] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:22:56.552661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab00cb-bad2-4382-a03c-10da52105507 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:56.553158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab00cb-bad2-4382-a03c-10da52105507 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:56.553280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab00cb-bad2-4382-a03c-10da52105507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:56.572700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-91ab00cb-bad2-4382-a03c-10da52105507 None None] MFA Rules not processed for user `eb360cd46a5c40dfa11e6d72bbaa47bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:22:56.573909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-91ab00cb-bad2-4382-a03c-10da52105507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:56.581323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1396/2785] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:22:57.215556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589d2d6-4c67-4d4c-8b5b-eb4a795fd93a service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:22:57.217043 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c589d2d6-4c67-4d4c-8b5b-eb4a795fd93a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:57.285798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589d2d6-4c67-4d4c-8b5b-eb4a795fd93a service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:22:57.290699 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de7d78-95d3-4981-a28d-0bc54d7e17a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:22:57.291304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7d78-95d3-4981-a28d-0bc54d7e17a3 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:57.291579 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7d78-95d3-4981-a28d-0bc54d7e17a3 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:57.291852 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7d78-95d3-4981-a28d-0bc54d7e17a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:57.294077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-40de7d78-95d3-4981-a28d-0bc54d7e17a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:57.305288 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de7d78-95d3-4981-a28d-0bc54d7e17a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:22:57.306896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de7d78-95d3-4981-a28d-0bc54d7e17a3 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:22:57.317219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1390/2786] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:22:59.273612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab00cb-bad2-4382-a03c-10da52105507 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:22:59.284380 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab00cb-bad2-4382-a03c-10da52105507 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:22:59.287871 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb218c5-60ff-4ed6-b945-39e86741c1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:22:59.288456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb218c5-60ff-4ed6-b945-39e86741c1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:22:59.288726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb218c5-60ff-4ed6-b945-39e86741c1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:22:59.288994 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb218c5-60ff-4ed6-b945-39e86741c1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:22:59.290768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cbb218c5-60ff-4ed6-b945-39e86741c1d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:22:59.300534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb218c5-60ff-4ed6-b945-39e86741c1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:22:59.301970 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb218c5-60ff-4ed6-b945-39e86741c1d6 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:22:59.310533 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1397/2787] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:22:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:23:06.453807 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de7d78-95d3-4981-a28d-0bc54d7e17a3 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:23:06.471298 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de7d78-95d3-4981-a28d-0bc54d7e17a3 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:23:06.476964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39801c-dd5e-4e0b-8704-76cfdd1fb892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:23:06.477606 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39801c-dd5e-4e0b-8704-76cfdd1fb892 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:23:06.477919 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39801c-dd5e-4e0b-8704-76cfdd1fb892 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:23:06.478196 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39801c-dd5e-4e0b-8704-76cfdd1fb892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:23:06.479961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bf39801c-dd5e-4e0b-8704-76cfdd1fb892 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:23:06.492804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39801c-dd5e-4e0b-8704-76cfdd1fb892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:23:06.494438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39801c-dd5e-4e0b-8704-76cfdd1fb892 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:23:06.506539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1391/2788] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:23:09.306267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=9 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:14.268809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb218c5-60ff-4ed6-b945-39e86741c1d6 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:23:14.270440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cbb218c5-60ff-4ed6-b945-39e86741c1d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:23:14.285330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb218c5-60ff-4ed6-b945-39e86741c1d6 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:23:14.289955 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:23:14.290577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:23:14.290860 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:23:14.291139 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] PATH_INFO: `/v3/users/fc43d6924d33463495be3645010e1575` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:23:14.292270 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc43d6924d33463495be3645010e1575)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:23:14.294857 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:23:14.341438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc43d6924d33463495be3645010e1575'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:23:14.349274 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc43d6924d33463495be3645010e1575'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:23:14.349939 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc43d6924d33463495be3645010e1575'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:23:14.350558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc43d6924d33463495be3645010e1575'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:23:14.358450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c0d3bdc-3577-409d-a517-46265825534a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc43d6924d33463495be3645010e1575'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:23:14.375917 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1398/2789] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:23:14 2022] DELETE /identity/v3/users/fc43d6924d33463495be3645010e1575 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:23:14.552324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39801c-dd5e-4e0b-8704-76cfdd1fb892 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:23:14.566037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39801c-dd5e-4e0b-8704-76cfdd1fb892 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:23:14.626177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:23:14.626797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:23:14.627076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:23:14.627348 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] PATH_INFO: `/v3/projects/29ad5c0935e84b6782bb722c9cfdefad` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:23:14.628448 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ad5c0935e84b6782bb722c9cfdefad)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:23:14.630366 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:23:14.678233 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ad5c0935e84b6782bb722c9cfdefad', 'request_id': 'req-73948553-e71d-41e7-8af6-c5a0c48408f8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:23:14.686484 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ad5c0935e84b6782bb722c9cfdefad', 'request_id': 'req-73948553-e71d-41e7-8af6-c5a0c48408f8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:23:14.692102 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ad5c0935e84b6782bb722c9cfdefad', 'request_id': 'req-73948553-e71d-41e7-8af6-c5a0c48408f8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:23:14.693173 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:14.705797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] The token cache is being invalidate because project 29ad5c0935e84b6782bb722c9cfdefad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:23:14.706086 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:23:14.706711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:23:14.708172 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1392/2790] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:23:14 2022] DELETE /identity/v3/projects/29ad5c0935e84b6782bb722c9cfdefad => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:23:24.372421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:24.703000 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:37.678851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459cb8b-4fa1-497a-b0b0-d35a02b14e3f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:24:37.679370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459cb8b-4fa1-497a-b0b0-d35a02b14e3f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:24:37.679370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459cb8b-4fa1-497a-b0b0-d35a02b14e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:24:37.699823 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b459cb8b-4fa1-497a-b0b0-d35a02b14e3f None None] MFA Rules not processed for user `eb360cd46a5c40dfa11e6d72bbaa47bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:24:37.701024 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b459cb8b-4fa1-497a-b0b0-d35a02b14e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:24:37.755815 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1399/2791] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:24:38.054848 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:24:38.056274 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:24:38.113949 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73948553-e71d-41e7-8af6-c5a0c48408f8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:24:38.117990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652197e-cdb4-4fb5-9cc9-e635840e942d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:24:38.118482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652197e-cdb4-4fb5-9cc9-e635840e942d service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:24:38.118760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652197e-cdb4-4fb5-9cc9-e635840e942d service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:24:38.119034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652197e-cdb4-4fb5-9cc9-e635840e942d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:24:38.121383 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7652197e-cdb4-4fb5-9cc9-e635840e942d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:24:38.131907 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652197e-cdb4-4fb5-9cc9-e635840e942d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:24:38.133327 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652197e-cdb4-4fb5-9cc9-e635840e942d service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:24:38.141416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1393/2792] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:24:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:24:47.748558 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=25 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:48.137781 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=26 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:03.388466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459cb8b-4fa1-497a-b0b0-d35a02b14e3f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:26:03.390028 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b459cb8b-4fa1-497a-b0b0-d35a02b14e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:26:03.472968 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459cb8b-4fa1-497a-b0b0-d35a02b14e3f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:26:03.478326 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06c737-3cd5-4ce3-99ee-cdf299a689f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:26:03.478984 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06c737-3cd5-4ce3-99ee-cdf299a689f9 service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:26:03.479370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06c737-3cd5-4ce3-99ee-cdf299a689f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:26:03.479676 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06c737-3cd5-4ce3-99ee-cdf299a689f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:26:03.482059 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ae06c737-3cd5-4ce3-99ee-cdf299a689f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:26:03.494763 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06c737-3cd5-4ce3-99ee-cdf299a689f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:26:03.496379 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06c737-3cd5-4ce3-99ee-cdf299a689f9 service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:26:03.509605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1400/2793] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:26:07.054378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f45699-d47a-46da-a001-45a01fad52a6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:26:07.054882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f45699-d47a-46da-a001-45a01fad52a6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:26:07.054992 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f45699-d47a-46da-a001-45a01fad52a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:26:07.074580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-54f45699-d47a-46da-a001-45a01fad52a6 None None] MFA Rules not processed for user `eb360cd46a5c40dfa11e6d72bbaa47bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:26:07.075777 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-54f45699-d47a-46da-a001-45a01fad52a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:26:07.083642 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1394/2794] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:26:13.505196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=32 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:17.069635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:17.164748 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06c737-3cd5-4ce3-99ee-cdf299a689f9 service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:26:17.166280 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ae06c737-3cd5-4ce3-99ee-cdf299a689f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:26:17.250888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06c737-3cd5-4ce3-99ee-cdf299a689f9 service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:26:17.256334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb38813-b774-4e29-9209-2c7b7e3919c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:26:17.256944 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb38813-b774-4e29-9209-2c7b7e3919c1 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:26:17.257222 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb38813-b774-4e29-9209-2c7b7e3919c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:26:17.257494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb38813-b774-4e29-9209-2c7b7e3919c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:26:17.259269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cbb38813-b774-4e29-9209-2c7b7e3919c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:26:17.270668 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb38813-b774-4e29-9209-2c7b7e3919c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:26:17.272244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb38813-b774-4e29-9209-2c7b7e3919c1 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:26:17.282597 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1401/2795] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:26:27.277238 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=34 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:25.881295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f45699-d47a-46da-a001-45a01fad52a6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:25.882719 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-54f45699-d47a-46da-a001-45a01fad52a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:25.938960 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f45699-d47a-46da-a001-45a01fad52a6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:25.943331 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9152e1b-4002-444a-94cd-f8dfe2eae341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:25.943933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9152e1b-4002-444a-94cd-f8dfe2eae341 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:25.944212 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9152e1b-4002-444a-94cd-f8dfe2eae341 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:25.947462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9152e1b-4002-444a-94cd-f8dfe2eae341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:25.947462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d9152e1b-4002-444a-94cd-f8dfe2eae341 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:25.959575 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9152e1b-4002-444a-94cd-f8dfe2eae341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:25.960982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9152e1b-4002-444a-94cd-f8dfe2eae341 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:25.971866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1395/2796] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:27:28.613397 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb38813-b774-4e29-9209-2c7b7e3919c1 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:28.622753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb38813-b774-4e29-9209-2c7b7e3919c1 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:28.626217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd874d19-75c1-4a31-bb1b-f635d69b7db6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:28.630016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd874d19-75c1-4a31-bb1b-f635d69b7db6 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:28.630307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd874d19-75c1-4a31-bb1b-f635d69b7db6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:28.630577 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd874d19-75c1-4a31-bb1b-f635d69b7db6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:28.632980 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dd874d19-75c1-4a31-bb1b-f635d69b7db6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:28.648174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd874d19-75c1-4a31-bb1b-f635d69b7db6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:28.649593 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd874d19-75c1-4a31-bb1b-f635d69b7db6 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:28.660921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1402/2797] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:27:35.967045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=26 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:38.655500 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:39.139166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9152e1b-4002-444a-94cd-f8dfe2eae341 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:39.140559 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d9152e1b-4002-444a-94cd-f8dfe2eae341 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:39.152225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9152e1b-4002-444a-94cd-f8dfe2eae341 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:39.155745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c344348-80d9-44c6-a883-9602442db4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:39.156348 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c344348-80d9-44c6-a883-9602442db4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:39.156624 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c344348-80d9-44c6-a883-9602442db4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:39.156888 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c344348-80d9-44c6-a883-9602442db4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:39.158533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2c344348-80d9-44c6-a883-9602442db4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:39.218743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c344348-80d9-44c6-a883-9602442db4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:39.220151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c344348-80d9-44c6-a883-9602442db4c3 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:39.230105 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1396/2798] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:27:41.990730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd874d19-75c1-4a31-bb1b-f635d69b7db6 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:42.002824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd874d19-75c1-4a31-bb1b-f635d69b7db6 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:42.009025 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa328d6c-e5e9-49d8-906c-423d544b7d5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:42.009662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa328d6c-e5e9-49d8-906c-423d544b7d5b service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.010018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa328d6c-e5e9-49d8-906c-423d544b7d5b service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.010206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa328d6c-e5e9-49d8-906c-423d544b7d5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.011923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fa328d6c-e5e9-49d8-906c-423d544b7d5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:42.028402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa328d6c-e5e9-49d8-906c-423d544b7d5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:42.030068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa328d6c-e5e9-49d8-906c-423d544b7d5b service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:42.043394 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1403/2799] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:27:42.063045 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c344348-80d9-44c6-a883-9602442db4c3 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:42.064791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2c344348-80d9-44c6-a883-9602442db4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:42.086974 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c344348-80d9-44c6-a883-9602442db4c3 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:42.092026 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:42.092925 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.093308 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.093725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] PATH_INFO: `/v3/users/eb360cd46a5c40dfa11e6d72bbaa47bc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.094993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb360cd46a5c40dfa11e6d72bbaa47bc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:42.099191 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:42.149395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb360cd46a5c40dfa11e6d72bbaa47bc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:42.157216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb360cd46a5c40dfa11e6d72bbaa47bc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:42.157905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb360cd46a5c40dfa11e6d72bbaa47bc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:42.158506 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb360cd46a5c40dfa11e6d72bbaa47bc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:42.165958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c1ca23a2-720a-4a41-aa66-28a0c6841b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb360cd46a5c40dfa11e6d72bbaa47bc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:42.183071 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1397/2800] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:27:42 2022] DELETE /identity/v3/users/eb360cd46a5c40dfa11e6d72bbaa47bc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:42.360992 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa328d6c-e5e9-49d8-906c-423d544b7d5b service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:42.372929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa328d6c-e5e9-49d8-906c-423d544b7d5b service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:42.452705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:42.453359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.453665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.453941 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] PATH_INFO: `/v3/projects/d9969a02aac342e3846ec2425fbc4199` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.455077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9969a02aac342e3846ec2425fbc4199)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:42.457018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:42.504192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9969a02aac342e3846ec2425fbc4199', 'request_id': 'req-8c50bd76-b507-4fb8-bc71-3270e3b9f136'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:42.509631 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9969a02aac342e3846ec2425fbc4199', 'request_id': 'req-8c50bd76-b507-4fb8-bc71-3270e3b9f136'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:42.516762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9969a02aac342e3846ec2425fbc4199', 'request_id': 'req-8c50bd76-b507-4fb8-bc71-3270e3b9f136'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:42.527881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] The token cache is being invalidate because project d9969a02aac342e3846ec2425fbc4199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:27:42.528167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:42.528786 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c50bd76-b507-4fb8-bc71-3270e3b9f136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:42.530282 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1404/2801] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:27:42 2022] DELETE /identity/v3/projects/d9969a02aac342e3846ec2425fbc4199 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:42.535122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f61092-cd25-4e07-bbda-e15fffe2cd00 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.535417 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f61092-cd25-4e07-bbda-e15fffe2cd00 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.535670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f61092-cd25-4e07-bbda-e15fffe2cd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.555430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-98f61092-cd25-4e07-bbda-e15fffe2cd00 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:42.556632 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-98f61092-cd25-4e07-bbda-e15fffe2cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:42.615918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1398/2802] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:42.623683 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ab39f-556c-4eaa-92a3-f280e1cef7b8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.623964 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ab39f-556c-4eaa-92a3-f280e1cef7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.624232 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ab39f-556c-4eaa-92a3-f280e1cef7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.644196 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c32ab39f-556c-4eaa-92a3-f280e1cef7b8 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:42.645386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c32ab39f-556c-4eaa-92a3-f280e1cef7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:42.653124 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1405/2803] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:42.657181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f61092-cd25-4e07-bbda-e15fffe2cd00 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:42.667128 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f61092-cd25-4e07-bbda-e15fffe2cd00 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:42.671926 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4d2e6-2e2c-446a-90b1-192d18bd5917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:42.672528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d2e6-2e2c-446a-90b1-192d18bd5917 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.672804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d2e6-2e2c-446a-90b1-192d18bd5917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.673075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d2e6-2e2c-446a-90b1-192d18bd5917 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.673828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4d2e6-2e2c-446a-90b1-192d18bd5917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:27:42.674039 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4d2e6-2e2c-446a-90b1-192d18bd5917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:42.676166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4d2e6-2e2c-446a-90b1-192d18bd5917 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:42.677734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:42.690959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1399/2804] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:27:42.695347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ab39f-556c-4eaa-92a3-f280e1cef7b8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:42.704532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ab39f-556c-4eaa-92a3-f280e1cef7b8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:42.709431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20b320-6a5a-4641-97d1-15901f4c5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:42.710059 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20b320-6a5a-4641-97d1-15901f4c5073 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.710338 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20b320-6a5a-4641-97d1-15901f4c5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.710610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20b320-6a5a-4641-97d1-15901f4c5073 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.711239 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20b320-6a5a-4641-97d1-15901f4c5073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:42.713132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20b320-6a5a-4641-97d1-15901f4c5073 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:42.763675 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1406/2805] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:27:42 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:27:42.764803 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4d2e6-2e2c-446a-90b1-192d18bd5917 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:42.776052 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4d2e6-2e2c-446a-90b1-192d18bd5917 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:42.840225 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c888c9-4d2e-48f5-af68-fc29ac859591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:42.840744 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c888c9-4d2e-48f5-af68-fc29ac859591 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.841022 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c888c9-4d2e-48f5-af68-fc29ac859591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.841290 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c888c9-4d2e-48f5-af68-fc29ac859591 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.841934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c888c9-4d2e-48f5-af68-fc29ac859591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:42.843818 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c888c9-4d2e-48f5-af68-fc29ac859591 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:42.866525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1400/2806] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:27:42 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:27:42.870596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20b320-6a5a-4641-97d1-15901f4c5073 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:42.880949 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20b320-6a5a-4641-97d1-15901f4c5073 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:42.885551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603288f-00c7-43ea-800f-f891f9854c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:42.886171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603288f-00c7-43ea-800f-f891f9854c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.886452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603288f-00c7-43ea-800f-f891f9854c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.886728 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603288f-00c7-43ea-800f-f891f9854c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.887370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603288f-00c7-43ea-800f-f891f9854c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:42.888951 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603288f-00c7-43ea-800f-f891f9854c83 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:42.899053 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1407/2807] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:27:42.902713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c888c9-4d2e-48f5-af68-fc29ac859591 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:42.913017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c888c9-4d2e-48f5-af68-fc29ac859591 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:42.917653 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603ab1d-c25c-4002-9f49-e12cf297ae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:42.918266 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603ab1d-c25c-4002-9f49-e12cf297ae42 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.918525 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603ab1d-c25c-4002-9f49-e12cf297ae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.918797 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603ab1d-c25c-4002-9f49-e12cf297ae42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.919432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603ab1d-c25c-4002-9f49-e12cf297ae42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:42.921015 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603ab1d-c25c-4002-9f49-e12cf297ae42 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:42.932104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1401/2808] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:27:42.936085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603288f-00c7-43ea-800f-f891f9854c83 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:42.945976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603288f-00c7-43ea-800f-f891f9854c83 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:42.950512 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba780d5c-6249-423e-be1c-5f16e8d89369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:42.951142 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba780d5c-6249-423e-be1c-5f16e8d89369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.951419 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba780d5c-6249-423e-be1c-5f16e8d89369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.951692 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba780d5c-6249-423e-be1c-5f16e8d89369 admin admin] PATH_INFO: `/v3/projects/cdacf54eb872402391b419b06cf76f4e/users/d4500820bad84d0f99dc3333381c340b/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:42.966147 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba780d5c-6249-423e-be1c-5f16e8d89369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdacf54eb872402391b419b06cf76f4e, user_id=d4500820bad84d0f99dc3333381c340b, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:42.968798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba780d5c-6249-423e-be1c-5f16e8d89369 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:42.982365 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1408/2809] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:27:42 2022] PUT /identity/v3/projects/cdacf54eb872402391b419b06cf76f4e/users/d4500820bad84d0f99dc3333381c340b/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:42.992734 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1036c0-a298-4f90-8f18-f20d91ffd021 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:42.993023 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1036c0-a298-4f90-8f18-f20d91ffd021 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:42.993300 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1036c0-a298-4f90-8f18-f20d91ffd021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:43.021772 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7e1036c0-a298-4f90-8f18-f20d91ffd021 None None] MFA Rules not processed for user `d4500820bad84d0f99dc3333381c340b`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:43.023019 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7e1036c0-a298-4f90-8f18-f20d91ffd021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:43.089069 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1402/2810] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:43.101319 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba780d5c-6249-423e-be1c-5f16e8d89369 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:43.103244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ba780d5c-6249-423e-be1c-5f16e8d89369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:43.109707 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:43.177690 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba780d5c-6249-423e-be1c-5f16e8d89369 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:43.183542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19caba-0bfe-4d0f-bb2b-0563f6096af2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02430b0097f94fa0a2015480a6ec68eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:43.184138 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19caba-0bfe-4d0f-bb2b-0563f6096af2 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:43.184416 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19caba-0bfe-4d0f-bb2b-0563f6096af2 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:43.184687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19caba-0bfe-4d0f-bb2b-0563f6096af2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:43.193031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19caba-0bfe-4d0f-bb2b-0563f6096af2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:43.194684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19caba-0bfe-4d0f-bb2b-0563f6096af2 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:43.203283 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1409/2811] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:27:48.405670 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1036c0-a298-4f90-8f18-f20d91ffd021 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:48.464219 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1036c0-a298-4f90-8f18-f20d91ffd021 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:48.468620 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:48.469244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:48.469521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:48.469829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] PATH_INFO: `/v3/users/d4500820bad84d0f99dc3333381c340b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:48.471968 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4500820bad84d0f99dc3333381c340b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:48.473916 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:48.476202 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:48.521101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4500820bad84d0f99dc3333381c340b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:48.528150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4500820bad84d0f99dc3333381c340b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:48.528892 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4500820bad84d0f99dc3333381c340b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:48.529488 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4500820bad84d0f99dc3333381c340b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:48.537592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4500820bad84d0f99dc3333381c340b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:48.554177 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1403/2812] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:27:48 2022] DELETE /identity/v3/users/d4500820bad84d0f99dc3333381c340b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:48.559227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4052c8-54e6-49dd-b6c6-ce232a1b2349 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:48.559227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4052c8-54e6-49dd-b6c6-ce232a1b2349 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:48.559227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4052c8-54e6-49dd-b6c6-ce232a1b2349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:48.579733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6a4052c8-54e6-49dd-b6c6-ce232a1b2349 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:48.581498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6a4052c8-54e6-49dd-b6c6-ce232a1b2349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:48.639250 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1410/2813] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:48.649367 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:48.650795 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:48.707778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea79078-7aae-4d15-adfe-322d9ff3f654 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:48.711405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32977532-79c2-42cb-8134-9e1cf231ffce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:48.712001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977532-79c2-42cb-8134-9e1cf231ffce service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:48.712275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977532-79c2-42cb-8134-9e1cf231ffce service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:48.712544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977532-79c2-42cb-8134-9e1cf231ffce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:48.721388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32977532-79c2-42cb-8134-9e1cf231ffce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:48.722836 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32977532-79c2-42cb-8134-9e1cf231ffce service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:48.732427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1404/2814] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:27:48.999466 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4052c8-54e6-49dd-b6c6-ce232a1b2349 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:49.001716 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6a4052c8-54e6-49dd-b6c6-ce232a1b2349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:49.018560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4052c8-54e6-49dd-b6c6-ce232a1b2349 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:49.023162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:49.023930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.024214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.024488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] PATH_INFO: `/v3/projects/cdacf54eb872402391b419b06cf76f4e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.025805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdacf54eb872402391b419b06cf76f4e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:49.027717 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:49.077292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdacf54eb872402391b419b06cf76f4e', 'request_id': 'req-bd62e78e-b19b-4119-bb1f-023c5524c21c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:49.082856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdacf54eb872402391b419b06cf76f4e', 'request_id': 'req-bd62e78e-b19b-4119-bb1f-023c5524c21c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:49.089821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdacf54eb872402391b419b06cf76f4e', 'request_id': 'req-bd62e78e-b19b-4119-bb1f-023c5524c21c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:49.100926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] The token cache is being invalidate because project cdacf54eb872402391b419b06cf76f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:27:49.101211 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:49.101856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-bd62e78e-b19b-4119-bb1f-023c5524c21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:49.103576 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1411/2815] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:27:48 2022] DELETE /identity/v3/projects/cdacf54eb872402391b419b06cf76f4e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:49.108361 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105454-4464-4753-8944-086a93f0e649 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.108644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105454-4464-4753-8944-086a93f0e649 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.108920 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105454-4464-4753-8944-086a93f0e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.128674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ef105454-4464-4753-8944-086a93f0e649 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:49.129921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ef105454-4464-4753-8944-086a93f0e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:49.187521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1405/2816] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:49.196489 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecbea-9a8f-4c50-9ef6-bd38b3a89d2d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.196769 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecbea-9a8f-4c50-9ef6-bd38b3a89d2d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.197039 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecbea-9a8f-4c50-9ef6-bd38b3a89d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.216998 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5c3ecbea-9a8f-4c50-9ef6-bd38b3a89d2d None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:49.218230 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5c3ecbea-9a8f-4c50-9ef6-bd38b3a89d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:49.226635 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1412/2817] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:49.231165 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef105454-4464-4753-8944-086a93f0e649 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:49.240893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef105454-4464-4753-8944-086a93f0e649 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:49.245436 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236321c-41df-40d4-ba07-8860ec0be64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:49.245996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236321c-41df-40d4-ba07-8860ec0be64e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.246275 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236321c-41df-40d4-ba07-8860ec0be64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.246544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236321c-41df-40d4-ba07-8860ec0be64e admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.247180 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236321c-41df-40d4-ba07-8860ec0be64e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:27:49.247482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236321c-41df-40d4-ba07-8860ec0be64e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:49.249053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236321c-41df-40d4-ba07-8860ec0be64e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:49.260138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1406/2818] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:27:49.264323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ecbea-9a8f-4c50-9ef6-bd38b3a89d2d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:49.274241 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ecbea-9a8f-4c50-9ef6-bd38b3a89d2d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:49.278876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ba713-6d09-4455-905b-c461ff1b1228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:49.279482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ba713-6d09-4455-905b-c461ff1b1228 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.279750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ba713-6d09-4455-905b-c461ff1b1228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.280020 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ba713-6d09-4455-905b-c461ff1b1228 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.280643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ba713-6d09-4455-905b-c461ff1b1228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:49.282557 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ba713-6d09-4455-905b-c461ff1b1228 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:49.287550 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:49.310491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1413/2819] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:27:49 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:27:49.314515 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236321c-41df-40d4-ba07-8860ec0be64e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:49.324185 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236321c-41df-40d4-ba07-8860ec0be64e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:49.332557 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:49.381811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20120f-ff9b-4919-ab06-700317ff8e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:49.382411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20120f-ff9b-4919-ab06-700317ff8e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.382689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20120f-ff9b-4919-ab06-700317ff8e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.382962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20120f-ff9b-4919-ab06-700317ff8e7e admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.383592 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20120f-ff9b-4919-ab06-700317ff8e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:49.385483 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20120f-ff9b-4919-ab06-700317ff8e7e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:49.406106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1407/2820] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:27:49 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:27:49.411016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ba713-6d09-4455-905b-c461ff1b1228 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:49.420960 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ba713-6d09-4455-905b-c461ff1b1228 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:49.425520 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bdc05-a720-4aa1-abb0-47cf081cfac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:49.426132 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bdc05-a720-4aa1-abb0-47cf081cfac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.426413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bdc05-a720-4aa1-abb0-47cf081cfac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.426682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bdc05-a720-4aa1-abb0-47cf081cfac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.427310 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bdc05-a720-4aa1-abb0-47cf081cfac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:49.428880 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bdc05-a720-4aa1-abb0-47cf081cfac4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:49.438854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1414/2821] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:27:49.442798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20120f-ff9b-4919-ab06-700317ff8e7e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:49.452315 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20120f-ff9b-4919-ab06-700317ff8e7e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:49.457867 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81607e-b2b7-47df-8434-ba35f0bc7cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:49.458468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81607e-b2b7-47df-8434-ba35f0bc7cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.458748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81607e-b2b7-47df-8434-ba35f0bc7cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.459021 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81607e-b2b7-47df-8434-ba35f0bc7cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.459666 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81607e-b2b7-47df-8434-ba35f0bc7cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:49.461273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81607e-b2b7-47df-8434-ba35f0bc7cdd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:49.472593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1408/2822] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:27:49.476688 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bdc05-a720-4aa1-abb0-47cf081cfac4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:49.487042 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bdc05-a720-4aa1-abb0-47cf081cfac4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:49.491768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75663c8a-fd3c-4d34-af08-3da14ff2166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:49.492408 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75663c8a-fd3c-4d34-af08-3da14ff2166c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.492687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75663c8a-fd3c-4d34-af08-3da14ff2166c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.492956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75663c8a-fd3c-4d34-af08-3da14ff2166c admin admin] PATH_INFO: `/v3/projects/f83beb10aa2b439c82ff4a6a1091aeb4/users/fae9efdd99b5467ba3e32226986dda49/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.507276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75663c8a-fd3c-4d34-af08-3da14ff2166c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83beb10aa2b439c82ff4a6a1091aeb4, user_id=fae9efdd99b5467ba3e32226986dda49, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:49.509855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75663c8a-fd3c-4d34-af08-3da14ff2166c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:49.522456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1415/2823] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:27:49 2022] PUT /identity/v3/projects/f83beb10aa2b439c82ff4a6a1091aeb4/users/fae9efdd99b5467ba3e32226986dda49/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:49.527435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7ba31-9f8a-48d2-be0f-4363e66959f9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.527725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7ba31-9f8a-48d2-be0f-4363e66959f9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.528005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7ba31-9f8a-48d2-be0f-4363e66959f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.547917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-45a7ba31-9f8a-48d2-be0f-4363e66959f9 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:49.549118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-45a7ba31-9f8a-48d2-be0f-4363e66959f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:49.606591 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1409/2824] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:49.616474 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75663c8a-fd3c-4d34-af08-3da14ff2166c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:49.618174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-75663c8a-fd3c-4d34-af08-3da14ff2166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:49.674318 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75663c8a-fd3c-4d34-af08-3da14ff2166c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:49.677936 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95b707-a4a0-435c-9cdf-48135673d285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:49.678535 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95b707-a4a0-435c-9cdf-48135673d285 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:49.678812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95b707-a4a0-435c-9cdf-48135673d285 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:49.679080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95b707-a4a0-435c-9cdf-48135673d285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:49.687824 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95b707-a4a0-435c-9cdf-48135673d285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:49.689293 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95b707-a4a0-435c-9cdf-48135673d285 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:49.699161 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1416/2825] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:27:50.308395 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ce3c6-cfe1-46d6-8a45-c1198b0af91b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:50.308684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ce3c6-cfe1-46d6-8a45-c1198b0af91b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:50.308955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ce3c6-cfe1-46d6-8a45-c1198b0af91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:50.335910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2f0ce3c6-cfe1-46d6-8a45-c1198b0af91b None None] MFA Rules not processed for user `fae9efdd99b5467ba3e32226986dda49`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:50.337520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2f0ce3c6-cfe1-46d6-8a45-c1198b0af91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:50.406388 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1410/2826] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:50.411409 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95b707-a4a0-435c-9cdf-48135673d285 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:50.420953 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95b707-a4a0-435c-9cdf-48135673d285 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:50.426149 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf356f-fb17-45d9-a4ca-c00cc731fcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:50.426758 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf356f-fb17-45d9-a4ca-c00cc731fcbf admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:50.427034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf356f-fb17-45d9-a4ca-c00cc731fcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:50.427307 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf356f-fb17-45d9-a4ca-c00cc731fcbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:50.427945 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf356f-fb17-45d9-a4ca-c00cc731fcbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:50.429867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf356f-fb17-45d9-a4ca-c00cc731fcbf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:50.459504 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1417/2827] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:27:50 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:27:50.463494 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ce3c6-cfe1-46d6-8a45-c1198b0af91b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:50.475334 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ce3c6-cfe1-46d6-8a45-c1198b0af91b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:50.494823 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:50.540505 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f0cba-ebe9-4492-9366-c817f16d4d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:50.541135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f0cba-ebe9-4492-9366-c817f16d4d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:50.541420 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f0cba-ebe9-4492-9366-c817f16d4d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:50.541728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f0cba-ebe9-4492-9366-c817f16d4d40 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:50.542372 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f0cba-ebe9-4492-9366-c817f16d4d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:50.545087 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f0cba-ebe9-4492-9366-c817f16d4d40 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:50.567682 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1411/2828] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:27:50 2022] POST /identity/v3/users => generated 309 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:27:50.571546 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf356f-fb17-45d9-a4ca-c00cc731fcbf admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:50.582236 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf356f-fb17-45d9-a4ca-c00cc731fcbf admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:50.587779 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de68a-74f4-4ea4-a299-bc9696106ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:50.589049 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de68a-74f4-4ea4-a299-bc9696106ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:50.589482 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de68a-74f4-4ea4-a299-bc9696106ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:50.589844 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de68a-74f4-4ea4-a299-bc9696106ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:50.590615 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8de68a-74f4-4ea4-a299-bc9696106ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:50.592296 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8de68a-74f4-4ea4-a299-bc9696106ce2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:50.604359 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1418/2829] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:27:50.608518 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f0cba-ebe9-4492-9366-c817f16d4d40 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:50.620941 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f0cba-ebe9-4492-9366-c817f16d4d40 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:50.625640 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dddaa-f8e2-40a4-8231-0f7dc402d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:50.626303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dddaa-f8e2-40a4-8231-0f7dc402d766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:50.626582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dddaa-f8e2-40a4-8231-0f7dc402d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:50.626853 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dddaa-f8e2-40a4-8231-0f7dc402d766 admin admin] PATH_INFO: `/v3/projects/a183cc62354a403991a120bfc0586c99/users/efcec3fe614641919e4407412ea88c02/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:50.641408 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dddaa-f8e2-40a4-8231-0f7dc402d766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a183cc62354a403991a120bfc0586c99, user_id=efcec3fe614641919e4407412ea88c02, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:50.644554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dddaa-f8e2-40a4-8231-0f7dc402d766 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:50.657498 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1412/2830] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:27:50 2022] PUT /identity/v3/projects/a183cc62354a403991a120bfc0586c99/users/efcec3fe614641919e4407412ea88c02/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:50.662137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de68a-74f4-4ea4-a299-bc9696106ce2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:50.672462 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de68a-74f4-4ea4-a299-bc9696106ce2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:50.727644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1360d3b-5cde-4b5d-b28d-3c78c8fad1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:50.728524 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1360d3b-5cde-4b5d-b28d-3c78c8fad1af admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:50.728797 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1360d3b-5cde-4b5d-b28d-3c78c8fad1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:50.729063 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1360d3b-5cde-4b5d-b28d-3c78c8fad1af admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:50.729726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1360d3b-5cde-4b5d-b28d-3c78c8fad1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:50.731287 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1360d3b-5cde-4b5d-b28d-3c78c8fad1af admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:50.741168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1419/2831] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:27:50.745282 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dddaa-f8e2-40a4-8231-0f7dc402d766 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:50.755597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dddaa-f8e2-40a4-8231-0f7dc402d766 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:50.760074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3cb56-f3ab-42bf-afc7-3c648f361a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:50.760717 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3cb56-f3ab-42bf-afc7-3c648f361a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:50.760993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3cb56-f3ab-42bf-afc7-3c648f361a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:50.761263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3cb56-f3ab-42bf-afc7-3c648f361a3e admin admin] PATH_INFO: `/v3/projects/a183cc62354a403991a120bfc0586c99/users/efcec3fe614641919e4407412ea88c02/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:50.763166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3cb56-f3ab-42bf-afc7-3c648f361a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a183cc62354a403991a120bfc0586c99, user_id=efcec3fe614641919e4407412ea88c02, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:50.765791 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3cb56-f3ab-42bf-afc7-3c648f361a3e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:50.776104 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1413/2832] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:27:50 2022] PUT /identity/v3/projects/a183cc62354a403991a120bfc0586c99/users/efcec3fe614641919e4407412ea88c02/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:27:51.655901 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b64ed-255b-4351-ac39-5e156f692085 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:51.656189 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b64ed-255b-4351-ac39-5e156f692085 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:51.656465 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b64ed-255b-4351-ac39-5e156f692085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:51.688033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-aa0b64ed-255b-4351-ac39-5e156f692085 None None] MFA Rules not processed for user `efcec3fe614641919e4407412ea88c02`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:51.689425 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aa0b64ed-255b-4351-ac39-5e156f692085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:51.693861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:51.764632 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1420/2833] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:51 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:52.219846 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3cb56-f3ab-42bf-afc7-3c648f361a3e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:52.221552 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-03d3cb56-f3ab-42bf-afc7-3c648f361a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:52.295822 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3cb56-f3ab-42bf-afc7-3c648f361a3e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:52.301875 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520f842-706f-4db9-8f81-8951f1d6ea71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:52.302490 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520f842-706f-4db9-8f81-8951f1d6ea71 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:52.302773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520f842-706f-4db9-8f81-8951f1d6ea71 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:52.303068 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520f842-706f-4db9-8f81-8951f1d6ea71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:52.304810 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d520f842-706f-4db9-8f81-8951f1d6ea71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:52.317684 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520f842-706f-4db9-8f81-8951f1d6ea71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:52.319187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520f842-706f-4db9-8f81-8951f1d6ea71 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:52.329562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1414/2834] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:27:52.787807 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b64ed-255b-4351-ac39-5e156f692085 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:52.853262 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b64ed-255b-4351-ac39-5e156f692085 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:52.857714 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:52.858345 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:52.858620 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:52.858890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] PATH_INFO: `/v3/users/fae9efdd99b5467ba3e32226986dda49` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:52.860001 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae9efdd99b5467ba3e32226986dda49)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:52.862540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:52.906967 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae9efdd99b5467ba3e32226986dda49'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:52.914685 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae9efdd99b5467ba3e32226986dda49'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:52.915302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae9efdd99b5467ba3e32226986dda49'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:52.915902 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae9efdd99b5467ba3e32226986dda49'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:52.922894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae9efdd99b5467ba3e32226986dda49'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:52.939616 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1421/2835] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:27:52 2022] DELETE /identity/v3/users/fae9efdd99b5467ba3e32226986dda49 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:53.113474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520f842-706f-4db9-8f81-8951f1d6ea71 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:53.124720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520f842-706f-4db9-8f81-8951f1d6ea71 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:53.181342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:53.182036 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:53.182374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:53.182686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] PATH_INFO: `/v3/projects/f83beb10aa2b439c82ff4a6a1091aeb4` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:53.183882 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83beb10aa2b439c82ff4a6a1091aeb4)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:53.185812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:53.187998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:53.234123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83beb10aa2b439c82ff4a6a1091aeb4', 'request_id': 'req-469544bb-5f43-4060-a963-1af604b7b10c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.241032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83beb10aa2b439c82ff4a6a1091aeb4', 'request_id': 'req-469544bb-5f43-4060-a963-1af604b7b10c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.246496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83beb10aa2b439c82ff4a6a1091aeb4', 'request_id': 'req-469544bb-5f43-4060-a963-1af604b7b10c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.257213 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] The token cache is being invalidate because project f83beb10aa2b439c82ff4a6a1091aeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:27:53.257495 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.258139 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.259593 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1415/2836] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:27:53 2022] DELETE /identity/v3/projects/f83beb10aa2b439c82ff4a6a1091aeb4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:53.263600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:53.265012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:53.278266 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441d059-1af2-4219-984b-90b6339fbd13 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:53.294752 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:53.337195 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:53.337862 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:53.338144 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:53.338417 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] PATH_INFO: `/v3/users/efcec3fe614641919e4407412ea88c02` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:53.339549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efcec3fe614641919e4407412ea88c02)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:53.341446 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:53.387448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efcec3fe614641919e4407412ea88c02'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.395248 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efcec3fe614641919e4407412ea88c02'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.395930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efcec3fe614641919e4407412ea88c02'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.396531 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efcec3fe614641919e4407412ea88c02'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.403432 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc795e77-abc5-4925-b533-409f7aaa71a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efcec3fe614641919e4407412ea88c02'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.420137 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1422/2837] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:27:53 2022] DELETE /identity/v3/users/efcec3fe614641919e4407412ea88c02 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:53.593342 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:53.594831 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:53.607639 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469544bb-5f43-4060-a963-1af604b7b10c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:53.666982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:53.667551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:53.667839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:53.668118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] PATH_INFO: `/v3/projects/a183cc62354a403991a120bfc0586c99` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:53.669442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a183cc62354a403991a120bfc0586c99)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:53.671399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:53.718326 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a183cc62354a403991a120bfc0586c99', 'request_id': 'req-74935e17-80f4-4cde-bfa9-51de588a92c8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.725567 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a183cc62354a403991a120bfc0586c99', 'request_id': 'req-74935e17-80f4-4cde-bfa9-51de588a92c8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.731349 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a183cc62354a403991a120bfc0586c99', 'request_id': 'req-74935e17-80f4-4cde-bfa9-51de588a92c8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.742595 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] The token cache is being invalidate because project a183cc62354a403991a120bfc0586c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:27:53.742881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.743499 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-74935e17-80f4-4cde-bfa9-51de588a92c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:53.744938 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1416/2838] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:27:53 2022] DELETE /identity/v3/projects/a183cc62354a403991a120bfc0586c99 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:53.749906 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff11d-29bf-4179-8f9e-a2c3520be503 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:53.750195 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff11d-29bf-4179-8f9e-a2c3520be503 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:53.750473 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ff11d-29bf-4179-8f9e-a2c3520be503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:53.771151 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-382ff11d-29bf-4179-8f9e-a2c3520be503 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:53.772351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-382ff11d-29bf-4179-8f9e-a2c3520be503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:53.830849 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1423/2839] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:53.840115 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c252b2a-82ab-4fc1-88b2-e2e644a6acc1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:53.840400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c252b2a-82ab-4fc1-88b2-e2e644a6acc1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:53.840674 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c252b2a-82ab-4fc1-88b2-e2e644a6acc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:53.860961 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0c252b2a-82ab-4fc1-88b2-e2e644a6acc1 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:53.862677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0c252b2a-82ab-4fc1-88b2-e2e644a6acc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:53.870399 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1417/2840] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:27:53.874613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ff11d-29bf-4179-8f9e-a2c3520be503 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:53.884737 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ff11d-29bf-4179-8f9e-a2c3520be503 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:53.889231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a32aa8-7971-48bb-bd0b-f3b1f35c0b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:53.889846 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a32aa8-7971-48bb-bd0b-f3b1f35c0b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:53.890122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a32aa8-7971-48bb-bd0b-f3b1f35c0b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:53.890391 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a32aa8-7971-48bb-bd0b-f3b1f35c0b27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:53.891023 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a32aa8-7971-48bb-bd0b-f3b1f35c0b27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:27:53.891321 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a32aa8-7971-48bb-bd0b-f3b1f35c0b27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:53.892884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a32aa8-7971-48bb-bd0b-f3b1f35c0b27 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:53.904012 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1424/2841] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:27:53.908153 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c252b2a-82ab-4fc1-88b2-e2e644a6acc1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:53.917321 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c252b2a-82ab-4fc1-88b2-e2e644a6acc1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:53.921958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8894b7-b93c-48d0-9007-65c5eee21ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:53.922551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8894b7-b93c-48d0-9007-65c5eee21ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:53.922856 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8894b7-b93c-48d0-9007-65c5eee21ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:53.923124 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8894b7-b93c-48d0-9007-65c5eee21ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:53.924271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8894b7-b93c-48d0-9007-65c5eee21ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:53.926370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8894b7-b93c-48d0-9007-65c5eee21ec7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:53.941337 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:53.954416 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1418/2842] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:27:53 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:27:53.958599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a32aa8-7971-48bb-bd0b-f3b1f35c0b27 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:53.968363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a32aa8-7971-48bb-bd0b-f3b1f35c0b27 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:53.992699 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:54.025396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447033-f200-42b8-9797-a04f11e4ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:54.026033 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447033-f200-42b8-9797-a04f11e4ee6c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:54.026315 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447033-f200-42b8-9797-a04f11e4ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:54.026586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447033-f200-42b8-9797-a04f11e4ee6c admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:54.027225 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43447033-f200-42b8-9797-a04f11e4ee6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:54.029120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43447033-f200-42b8-9797-a04f11e4ee6c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:54.050782 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1425/2843] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:27:53 2022] POST /identity/v3/users => generated 280 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:27:54.054828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8894b7-b93c-48d0-9007-65c5eee21ec7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:54.064957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8894b7-b93c-48d0-9007-65c5eee21ec7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:54.069715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2abaf9-7a59-442a-a70a-6c0941250936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:54.070304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2abaf9-7a59-442a-a70a-6c0941250936 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:54.070580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2abaf9-7a59-442a-a70a-6c0941250936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:54.070845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2abaf9-7a59-442a-a70a-6c0941250936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:54.071519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2abaf9-7a59-442a-a70a-6c0941250936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:54.073076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2abaf9-7a59-442a-a70a-6c0941250936 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:54.082700 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1419/2844] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:27:54.086534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447033-f200-42b8-9797-a04f11e4ee6c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:54.097342 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447033-f200-42b8-9797-a04f11e4ee6c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:54.101974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787baa0a-977d-43a3-9f4a-0e9819356725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:54.102561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787baa0a-977d-43a3-9f4a-0e9819356725 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:54.103105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787baa0a-977d-43a3-9f4a-0e9819356725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:54.103385 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787baa0a-977d-43a3-9f4a-0e9819356725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:54.104022 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787baa0a-977d-43a3-9f4a-0e9819356725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:54.105604 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787baa0a-977d-43a3-9f4a-0e9819356725 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:54.116961 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1426/2845] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:27:54.120987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2abaf9-7a59-442a-a70a-6c0941250936 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:54.130729 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2abaf9-7a59-442a-a70a-6c0941250936 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:54.135278 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6382de8-81aa-4d01-a0d5-755c4113830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:54.135918 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6382de8-81aa-4d01-a0d5-755c4113830a admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:54.136195 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6382de8-81aa-4d01-a0d5-755c4113830a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:54.136468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6382de8-81aa-4d01-a0d5-755c4113830a admin admin] PATH_INFO: `/v3/projects/191f9d1dcfc94d64b349320ae02987ec/users/d9a088d5461348959530d7827af3c10d/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:54.151113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6382de8-81aa-4d01-a0d5-755c4113830a admin admin] RBAC: Authorizing `identity:create_grant(project_id=191f9d1dcfc94d64b349320ae02987ec, user_id=d9a088d5461348959530d7827af3c10d, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:54.153790 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6382de8-81aa-4d01-a0d5-755c4113830a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:54.167025 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1420/2846] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:27:54 2022] PUT /identity/v3/projects/191f9d1dcfc94d64b349320ae02987ec/users/d9a088d5461348959530d7827af3c10d/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:54.178173 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ba90a-607e-4ad5-8dc3-0087f02e79ba None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:54.178400 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ba90a-607e-4ad5-8dc3-0087f02e79ba None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:54.178672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ba90a-607e-4ad5-8dc3-0087f02e79ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:54.205586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1c3ba90a-607e-4ad5-8dc3-0087f02e79ba None None] MFA Rules not processed for user `d9a088d5461348959530d7827af3c10d`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:54.206828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1c3ba90a-607e-4ad5-8dc3-0087f02e79ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:54.269911 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1427/2847] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:54.304465 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6382de8-81aa-4d01-a0d5-755c4113830a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:54.306235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a6382de8-81aa-4d01-a0d5-755c4113830a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:54.362392 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6382de8-81aa-4d01-a0d5-755c4113830a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:54.366120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661660c-a70e-4d82-a2d3-47c340e3ccbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:54.366722 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661660c-a70e-4d82-a2d3-47c340e3ccbf service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:54.367001 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661660c-a70e-4d82-a2d3-47c340e3ccbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:54.367273 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661660c-a70e-4d82-a2d3-47c340e3ccbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:54.375423 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661660c-a70e-4d82-a2d3-47c340e3ccbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:54.376930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661660c-a70e-4d82-a2d3-47c340e3ccbf service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:54.385496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1421/2848] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:27:54.401773 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ba90a-607e-4ad5-8dc3-0087f02e79ba None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:54.464590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ba90a-607e-4ad5-8dc3-0087f02e79ba None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:54.469217 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:54.469890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:54.470177 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:54.471066 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] PATH_INFO: `/v3/users/d9a088d5461348959530d7827af3c10d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:54.472259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a088d5461348959530d7827af3c10d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:54.474198 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:54.512648 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:54.522429 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a088d5461348959530d7827af3c10d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:54.529663 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a088d5461348959530d7827af3c10d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:54.530301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a088d5461348959530d7827af3c10d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:54.530903 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a088d5461348959530d7827af3c10d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:54.538596 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a088d5461348959530d7827af3c10d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:54.555312 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1428/2849] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:27:54 2022] DELETE /identity/v3/users/d9a088d5461348959530d7827af3c10d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:54.559733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beea5b5-5837-4f35-a300-149c4fcf0322 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:54.560020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beea5b5-5837-4f35-a300-149c4fcf0322 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:54.560295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beea5b5-5837-4f35-a300-149c4fcf0322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:54.580896 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8beea5b5-5837-4f35-a300-149c4fcf0322 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:54.582181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8beea5b5-5837-4f35-a300-149c4fcf0322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:54.639978 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1422/2850] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:54.650101 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:54.651532 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:54.708891 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e2342-4a94-4885-9276-42537b0edcd5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:54.712567 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8465933-14af-4cf8-9073-b87e20c90055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:54.713169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8465933-14af-4cf8-9073-b87e20c90055 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:54.713450 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8465933-14af-4cf8-9073-b87e20c90055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:54.713750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8465933-14af-4cf8-9073-b87e20c90055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:54.723284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8465933-14af-4cf8-9073-b87e20c90055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:54.724643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8465933-14af-4cf8-9073-b87e20c90055 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:54.734167 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1429/2851] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:27:54.993876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beea5b5-5837-4f35-a300-149c4fcf0322 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:54.995311 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8beea5b5-5837-4f35-a300-149c4fcf0322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:55.011521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beea5b5-5837-4f35-a300-149c4fcf0322 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.016604 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.017964 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.019373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.019999 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] PATH_INFO: `/v3/projects/191f9d1dcfc94d64b349320ae02987ec` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.021261 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=191f9d1dcfc94d64b349320ae02987ec)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.023330 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.068197 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191f9d1dcfc94d64b349320ae02987ec', 'request_id': 'req-354be25b-9526-47ac-ad08-2966d0969732'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:55.075954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191f9d1dcfc94d64b349320ae02987ec', 'request_id': 'req-354be25b-9526-47ac-ad08-2966d0969732'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:55.077249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:55.083743 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191f9d1dcfc94d64b349320ae02987ec', 'request_id': 'req-354be25b-9526-47ac-ad08-2966d0969732'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:55.095730 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] The token cache is being invalidate because project 191f9d1dcfc94d64b349320ae02987ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:27:55.096217 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:55.096863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-354be25b-9526-47ac-ad08-2966d0969732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:55.098373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1423/2852] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:27:54 2022] DELETE /identity/v3/projects/191f9d1dcfc94d64b349320ae02987ec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:55.103410 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168b6c-610c-49b7-8720-d95830d41c59 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.103894 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168b6c-610c-49b7-8720-d95830d41c59 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.103997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168b6c-610c-49b7-8720-d95830d41c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.123267 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b2168b6c-610c-49b7-8720-d95830d41c59 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:55.124468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b2168b6c-610c-49b7-8720-d95830d41c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:55.182739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1430/2853] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:55.191647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fc13f-8c13-4b4a-b7ce-fd2c2bed6ab2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.191928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fc13f-8c13-4b4a-b7ce-fd2c2bed6ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.192223 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fc13f-8c13-4b4a-b7ce-fd2c2bed6ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.212055 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5f3fc13f-8c13-4b4a-b7ce-fd2c2bed6ab2 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:55.213253 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5f3fc13f-8c13-4b4a-b7ce-fd2c2bed6ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:55.221643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1424/2854] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:27:55.225712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2168b6c-610c-49b7-8720-d95830d41c59 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.235556 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2168b6c-610c-49b7-8720-d95830d41c59 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.240214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8085cb-cdeb-4842-ba0b-4614b53d8995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.240750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8085cb-cdeb-4842-ba0b-4614b53d8995 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.241029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8085cb-cdeb-4842-ba0b-4614b53d8995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.241302 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8085cb-cdeb-4842-ba0b-4614b53d8995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.241975 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8085cb-cdeb-4842-ba0b-4614b53d8995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:27:55.242279 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8085cb-cdeb-4842-ba0b-4614b53d8995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.243854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8085cb-cdeb-4842-ba0b-4614b53d8995 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.255325 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1431/2855] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 12:27:55.259518 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fc13f-8c13-4b4a-b7ce-fd2c2bed6ab2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.269006 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fc13f-8c13-4b4a-b7ce-fd2c2bed6ab2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.273703 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcadbe5-57fc-46da-b497-3d36cd7f2b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.274294 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcadbe5-57fc-46da-b497-3d36cd7f2b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.274571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcadbe5-57fc-46da-b497-3d36cd7f2b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.274842 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcadbe5-57fc-46da-b497-3d36cd7f2b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.275472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcadbe5-57fc-46da-b497-3d36cd7f2b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.277344 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcadbe5-57fc-46da-b497-3d36cd7f2b90 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.304190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1425/2856] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:27:55 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:27:55.308278 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8085cb-cdeb-4842-ba0b-4614b53d8995 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.318219 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8085cb-cdeb-4842-ba0b-4614b53d8995 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.360159 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:55.376640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62977e6-0cda-46c0-8a74-eb20ac2366b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.377320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62977e6-0cda-46c0-8a74-eb20ac2366b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.377578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62977e6-0cda-46c0-8a74-eb20ac2366b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.377888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62977e6-0cda-46c0-8a74-eb20ac2366b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.378507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62977e6-0cda-46c0-8a74-eb20ac2366b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.380428 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62977e6-0cda-46c0-8a74-eb20ac2366b5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.401700 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1432/2857] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:27:55 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:27:55.405837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcadbe5-57fc-46da-b497-3d36cd7f2b90 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.416714 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcadbe5-57fc-46da-b497-3d36cd7f2b90 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.421254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5252f6-e75e-413d-b3f9-44757d786603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.421874 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5252f6-e75e-413d-b3f9-44757d786603 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.422152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5252f6-e75e-413d-b3f9-44757d786603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.422421 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5252f6-e75e-413d-b3f9-44757d786603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.423051 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5252f6-e75e-413d-b3f9-44757d786603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.424634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5252f6-e75e-413d-b3f9-44757d786603 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.434226 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1426/2858] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:27:55.438087 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62977e6-0cda-46c0-8a74-eb20ac2366b5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.447965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62977e6-0cda-46c0-8a74-eb20ac2366b5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.452667 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca89f6d-9b89-4d89-94ae-0c121175254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.453281 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca89f6d-9b89-4d89-94ae-0c121175254b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.453560 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca89f6d-9b89-4d89-94ae-0c121175254b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.453856 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca89f6d-9b89-4d89-94ae-0c121175254b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.454494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca89f6d-9b89-4d89-94ae-0c121175254b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.456645 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca89f6d-9b89-4d89-94ae-0c121175254b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.467115 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1433/2859] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:27:55.472210 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5252f6-e75e-413d-b3f9-44757d786603 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.482771 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5252f6-e75e-413d-b3f9-44757d786603 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.487796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcb8d-4fbf-4918-b7d9-e9f610ad7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.488529 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcb8d-4fbf-4918-b7d9-e9f610ad7b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.488954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcb8d-4fbf-4918-b7d9-e9f610ad7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.489319 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcb8d-4fbf-4918-b7d9-e9f610ad7b03 admin admin] PATH_INFO: `/v3/projects/7126bb0e59cd4eaea29e2e15d507879c/users/b178d1f28c044b8eac3424c670abda2d/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.503872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bcb8d-4fbf-4918-b7d9-e9f610ad7b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7126bb0e59cd4eaea29e2e15d507879c, user_id=b178d1f28c044b8eac3424c670abda2d, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.506478 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bcb8d-4fbf-4918-b7d9-e9f610ad7b03 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.519280 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1427/2860] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:27:55 2022] PUT /identity/v3/projects/7126bb0e59cd4eaea29e2e15d507879c/users/b178d1f28c044b8eac3424c670abda2d/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:55.584496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850d02-088d-467f-8906-d0d1b274bc63 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.584909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850d02-088d-467f-8906-d0d1b274bc63 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.585186 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850d02-088d-467f-8906-d0d1b274bc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.612640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0c850d02-088d-467f-8906-d0d1b274bc63 None None] MFA Rules not processed for user `b178d1f28c044b8eac3424c670abda2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:55.613877 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0c850d02-088d-467f-8906-d0d1b274bc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:55.677120 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1434/2861] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:55.681884 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcb8d-4fbf-4918-b7d9-e9f610ad7b03 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.742103 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcb8d-4fbf-4918-b7d9-e9f610ad7b03 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.746658 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f219-89f7-4377-8c50-2fb3f308639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.747253 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f219-89f7-4377-8c50-2fb3f308639a admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.747533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f219-89f7-4377-8c50-2fb3f308639a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.747806 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f219-89f7-4377-8c50-2fb3f308639a admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.748435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6f219-89f7-4377-8c50-2fb3f308639a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.750358 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6f219-89f7-4377-8c50-2fb3f308639a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.778634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1428/2862] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:27:55 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:27:55.782613 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c850d02-088d-467f-8906-d0d1b274bc63 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.793404 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c850d02-088d-467f-8906-d0d1b274bc63 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.849525 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe7b1-69fa-43e4-ac26-8c54f9da5d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.850158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe7b1-69fa-43e4-ac26-8c54f9da5d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.850435 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe7b1-69fa-43e4-ac26-8c54f9da5d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.850755 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe7b1-69fa-43e4-ac26-8c54f9da5d6b admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.851538 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffe7b1-69fa-43e4-ac26-8c54f9da5d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.853789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffe7b1-69fa-43e4-ac26-8c54f9da5d6b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.876069 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1435/2863] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:27:55 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:27:55.880438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f219-89f7-4377-8c50-2fb3f308639a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.890647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f219-89f7-4377-8c50-2fb3f308639a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.895934 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7da56-4781-488e-b7a9-2cfc6b06eb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.896523 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7da56-4781-488e-b7a9-2cfc6b06eb2c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.896798 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7da56-4781-488e-b7a9-2cfc6b06eb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.897067 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7da56-4781-488e-b7a9-2cfc6b06eb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.897726 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7da56-4781-488e-b7a9-2cfc6b06eb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.899324 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7da56-4781-488e-b7a9-2cfc6b06eb2c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.909996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1429/2864] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:27:55.914159 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe7b1-69fa-43e4-ac26-8c54f9da5d6b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.924602 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe7b1-69fa-43e4-ac26-8c54f9da5d6b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:55.929162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec030b-807e-4990-aa78-72f36cba7b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:55.929838 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec030b-807e-4990-aa78-72f36cba7b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:55.930122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec030b-807e-4990-aa78-72f36cba7b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:55.930395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec030b-807e-4990-aa78-72f36cba7b19 admin admin] PATH_INFO: `/v3/projects/42f5c45a13084c4f9952503403f46178/users/c84e30e7c73b4c5b955526e9e065eddd/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:55.945377 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec030b-807e-4990-aa78-72f36cba7b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f5c45a13084c4f9952503403f46178, user_id=c84e30e7c73b4c5b955526e9e065eddd, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:55.948037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec030b-807e-4990-aa78-72f36cba7b19 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:55.960561 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1436/2865] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:27:55 2022] PUT /identity/v3/projects/42f5c45a13084c4f9952503403f46178/users/c84e30e7c73b4c5b955526e9e065eddd/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:55.964548 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7da56-4781-488e-b7a9-2cfc6b06eb2c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:55.974611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7da56-4781-488e-b7a9-2cfc6b06eb2c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:56.023622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:56.032034 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c4831-73a5-469d-98b1-ec70e655a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:56.032586 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c4831-73a5-469d-98b1-ec70e655a08b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:56.033093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c4831-73a5-469d-98b1-ec70e655a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:56.033565 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c4831-73a5-469d-98b1-ec70e655a08b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:56.034486 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c4831-73a5-469d-98b1-ec70e655a08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:56.036080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c4831-73a5-469d-98b1-ec70e655a08b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:56.045812 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1430/2866] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:27:56.050477 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec030b-807e-4990-aa78-72f36cba7b19 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:56.060619 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec030b-807e-4990-aa78-72f36cba7b19 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:56.065923 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81559040-62e8-4db5-a78f-585950bdcf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:56.066570 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81559040-62e8-4db5-a78f-585950bdcf41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:56.066848 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81559040-62e8-4db5-a78f-585950bdcf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:56.067122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81559040-62e8-4db5-a78f-585950bdcf41 admin admin] PATH_INFO: `/v3/projects/42f5c45a13084c4f9952503403f46178/users/c84e30e7c73b4c5b955526e9e065eddd/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:56.069182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81559040-62e8-4db5-a78f-585950bdcf41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f5c45a13084c4f9952503403f46178, user_id=c84e30e7c73b4c5b955526e9e065eddd, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:56.071819 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81559040-62e8-4db5-a78f-585950bdcf41 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:56.082141 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1437/2867] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:27:56 2022] PUT /identity/v3/projects/42f5c45a13084c4f9952503403f46178/users/c84e30e7c73b4c5b955526e9e065eddd/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:56.091921 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb354c-d925-4c3f-85aa-fadeb9361934 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:56.092207 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb354c-d925-4c3f-85aa-fadeb9361934 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:56.092482 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb354c-d925-4c3f-85aa-fadeb9361934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:56.120521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b2fb354c-d925-4c3f-85aa-fadeb9361934 None None] MFA Rules not processed for user `c84e30e7c73b4c5b955526e9e065eddd`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:56.121757 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b2fb354c-d925-4c3f-85aa-fadeb9361934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:56.187538 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1431/2868] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:56.199145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81559040-62e8-4db5-a78f-585950bdcf41 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:56.200870 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-81559040-62e8-4db5-a78f-585950bdcf41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:56.207323 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:56.260113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81559040-62e8-4db5-a78f-585950bdcf41 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:56.263739 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262e309-f2c7-4584-a470-1984fdb4de0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:56.264334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e309-f2c7-4584-a470-1984fdb4de0d service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:56.264611 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e309-f2c7-4584-a470-1984fdb4de0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:56.264881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e309-f2c7-4584-a470-1984fdb4de0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:56.320075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262e309-f2c7-4584-a470-1984fdb4de0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:56.321488 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262e309-f2c7-4584-a470-1984fdb4de0d service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:56.330320 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1438/2869] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:27:58.861054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb354c-d925-4c3f-85aa-fadeb9361934 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:58.921936 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb354c-d925-4c3f-85aa-fadeb9361934 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:58.926752 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:58.927379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:58.927660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:58.927932 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] PATH_INFO: `/v3/users/b178d1f28c044b8eac3424c670abda2d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:58.929049 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b178d1f28c044b8eac3424c670abda2d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:58.930967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:58.978379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b178d1f28c044b8eac3424c670abda2d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:58.985376 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b178d1f28c044b8eac3424c670abda2d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:58.986071 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b178d1f28c044b8eac3424c670abda2d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:58.986669 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b178d1f28c044b8eac3424c670abda2d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:58.993883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b178d1f28c044b8eac3424c670abda2d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.004713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:59.012464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1432/2870] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:27:58 2022] DELETE /identity/v3/users/b178d1f28c044b8eac3424c670abda2d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:59.016924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7ddeb-e763-4f8c-b8b6-ca5a60656a44 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:59.017400 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7ddeb-e763-4f8c-b8b6-ca5a60656a44 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:59.017511 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7ddeb-e763-4f8c-b8b6-ca5a60656a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:59.037314 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6cc7ddeb-e763-4f8c-b8b6-ca5a60656a44 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:27:59.038526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6cc7ddeb-e763-4f8c-b8b6-ca5a60656a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:59.096534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1439/2871] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:27:59.107253 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:59.108644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:59.165818 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eff0d-05f4-4de7-8d86-1bbf57583b2d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:59.169403 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8009bfe-5729-4bcf-9f57-35c3931649d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:59.170032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8009bfe-5729-4bcf-9f57-35c3931649d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:59.170314 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8009bfe-5729-4bcf-9f57-35c3931649d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:59.170585 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8009bfe-5729-4bcf-9f57-35c3931649d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:59.179573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8009bfe-5729-4bcf-9f57-35c3931649d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:59.180990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8009bfe-5729-4bcf-9f57-35c3931649d2 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:59.190181 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1433/2872] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:27:59.457311 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7ddeb-e763-4f8c-b8b6-ca5a60656a44 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:59.459002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6cc7ddeb-e763-4f8c-b8b6-ca5a60656a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:59.471009 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7ddeb-e763-4f8c-b8b6-ca5a60656a44 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:59.475828 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:59.476548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:59.476787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:59.477006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] PATH_INFO: `/v3/projects/7126bb0e59cd4eaea29e2e15d507879c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:59.485019 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7126bb0e59cd4eaea29e2e15d507879c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:59.487060 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:59.533395 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7126bb0e59cd4eaea29e2e15d507879c', 'request_id': 'req-62b52d47-5326-4220-97d9-01d28d7f040d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.537367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:59.540164 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7126bb0e59cd4eaea29e2e15d507879c', 'request_id': 'req-62b52d47-5326-4220-97d9-01d28d7f040d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.547910 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7126bb0e59cd4eaea29e2e15d507879c', 'request_id': 'req-62b52d47-5326-4220-97d9-01d28d7f040d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.559206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] The token cache is being invalidate because project 7126bb0e59cd4eaea29e2e15d507879c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:27:59.559491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.560107 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.561600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1440/2873] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:27:59 2022] DELETE /identity/v3/projects/7126bb0e59cd4eaea29e2e15d507879c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:59.565561 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8009bfe-5729-4bcf-9f57-35c3931649d2 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:59.575677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8009bfe-5729-4bcf-9f57-35c3931649d2 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:27:59.631435 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:27:59.631982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:27:59.632261 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:27:59.632533 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] PATH_INFO: `/v3/users/c84e30e7c73b4c5b955526e9e065eddd` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:27:59.633645 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84e30e7c73b4c5b955526e9e065eddd)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:27:59.635553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:27:59.679907 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84e30e7c73b4c5b955526e9e065eddd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.687200 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84e30e7c73b4c5b955526e9e065eddd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.687813 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84e30e7c73b4c5b955526e9e065eddd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.688426 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84e30e7c73b4c5b955526e9e065eddd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.695890 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a87ea445-1cb0-441a-8a4b-9d6b49132512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84e30e7c73b4c5b955526e9e065eddd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:27:59.712242 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1434/2874] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:27:59 2022] DELETE /identity/v3/users/c84e30e7c73b4c5b955526e9e065eddd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:27:59.980541 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:27:59.981987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:27:59.998303 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b52d47-5326-4220-97d9-01d28d7f040d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:00.056340 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:00.057016 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.057226 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.057494 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] PATH_INFO: `/v3/projects/42f5c45a13084c4f9952503403f46178` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.058618 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f5c45a13084c4f9952503403f46178)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:00.060508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:00.106191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f5c45a13084c4f9952503403f46178', 'request_id': 'req-a4714fb5-6250-4d64-b045-3c8bc81ff05e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:00.111438 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f5c45a13084c4f9952503403f46178', 'request_id': 'req-a4714fb5-6250-4d64-b045-3c8bc81ff05e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:00.119110 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f5c45a13084c4f9952503403f46178', 'request_id': 'req-a4714fb5-6250-4d64-b045-3c8bc81ff05e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:00.129845 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] The token cache is being invalidate because project 42f5c45a13084c4f9952503403f46178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:28:00.130129 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:00.130753 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a4714fb5-6250-4d64-b045-3c8bc81ff05e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:00.132194 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1441/2875] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:27:59 2022] DELETE /identity/v3/projects/42f5c45a13084c4f9952503403f46178 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:00.136924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39fcc8-e604-45be-be61-378ad5377b31 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.137378 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39fcc8-e604-45be-be61-378ad5377b31 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.137489 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39fcc8-e604-45be-be61-378ad5377b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.157030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fe39fcc8-e604-45be-be61-378ad5377b31 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:00.158190 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fe39fcc8-e604-45be-be61-378ad5377b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:00.170847 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:00.223101 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1435/2876] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:28:00.232171 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a3a7d-8494-4d2c-8050-aeb0cfc6ba7f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.232451 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a3a7d-8494-4d2c-8050-aeb0cfc6ba7f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.232723 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a3a7d-8494-4d2c-8050-aeb0cfc6ba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.254077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-138a3a7d-8494-4d2c-8050-aeb0cfc6ba7f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:00.255269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-138a3a7d-8494-4d2c-8050-aeb0cfc6ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:00.262986 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1442/2877] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:28:00.267085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39fcc8-e604-45be-be61-378ad5377b31 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:00.276731 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39fcc8-e604-45be-be61-378ad5377b31 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:00.281216 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d1872-82ef-49c7-8281-92f49ebfa993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:00.281839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d1872-82ef-49c7-8281-92f49ebfa993 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.282118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d1872-82ef-49c7-8281-92f49ebfa993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.282387 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d1872-82ef-49c7-8281-92f49ebfa993 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.283028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d1872-82ef-49c7-8281-92f49ebfa993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:28:00.283328 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d1872-82ef-49c7-8281-92f49ebfa993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:00.285411 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d1872-82ef-49c7-8281-92f49ebfa993 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:00.296659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1436/2878] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:28:00.301444 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a3a7d-8494-4d2c-8050-aeb0cfc6ba7f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:00.310551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a3a7d-8494-4d2c-8050-aeb0cfc6ba7f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:00.315218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8e520-2712-47c8-80ce-823b2f28b058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:00.315812 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8e520-2712-47c8-80ce-823b2f28b058 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.316085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8e520-2712-47c8-80ce-823b2f28b058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.316354 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8e520-2712-47c8-80ce-823b2f28b058 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.316976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8e520-2712-47c8-80ce-823b2f28b058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:00.318921 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8e520-2712-47c8-80ce-823b2f28b058 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:00.345308 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1443/2879] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:28:00 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:28:00.350106 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d1872-82ef-49c7-8281-92f49ebfa993 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:00.360176 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d1872-82ef-49c7-8281-92f49ebfa993 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:00.416206 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0991c-8d4b-445b-9a12-e3622ff106bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:00.416738 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0991c-8d4b-445b-9a12-e3622ff106bb admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.417017 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0991c-8d4b-445b-9a12-e3622ff106bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.417289 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0991c-8d4b-445b-9a12-e3622ff106bb admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.417951 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0991c-8d4b-445b-9a12-e3622ff106bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:00.419851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0991c-8d4b-445b-9a12-e3622ff106bb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:00.440582 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1437/2880] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:28:00 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:28:00.445014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8e520-2712-47c8-80ce-823b2f28b058 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:00.455370 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8e520-2712-47c8-80ce-823b2f28b058 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:00.460502 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b0403-40a4-47cb-a4ff-e56963b8c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:00.461089 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0403-40a4-47cb-a4ff-e56963b8c0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.461367 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0403-40a4-47cb-a4ff-e56963b8c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.461662 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0403-40a4-47cb-a4ff-e56963b8c0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.462299 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b0403-40a4-47cb-a4ff-e56963b8c0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:00.463922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b0403-40a4-47cb-a4ff-e56963b8c0a0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:00.474206 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1444/2881] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:00.478295 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0991c-8d4b-445b-9a12-e3622ff106bb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:00.488956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0991c-8d4b-445b-9a12-e3622ff106bb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:00.494054 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e9aaa-16d0-402a-8c21-65c313f08839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:00.494660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e9aaa-16d0-402a-8c21-65c313f08839 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.494930 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e9aaa-16d0-402a-8c21-65c313f08839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.495228 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e9aaa-16d0-402a-8c21-65c313f08839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.495863 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e9aaa-16d0-402a-8c21-65c313f08839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:00.497454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e9aaa-16d0-402a-8c21-65c313f08839 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:00.508562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1438/2882] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:00.512796 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b0403-40a4-47cb-a4ff-e56963b8c0a0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:00.524002 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b0403-40a4-47cb-a4ff-e56963b8c0a0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:00.529546 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae820b-59cd-4c42-bbfa-9f2e870f48b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:00.530284 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae820b-59cd-4c42-bbfa-9f2e870f48b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.530565 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae820b-59cd-4c42-bbfa-9f2e870f48b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.530855 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae820b-59cd-4c42-bbfa-9f2e870f48b5 admin admin] PATH_INFO: `/v3/projects/4da39e06d9364e7592d05d1bac326486/users/be6c77aa9db94c4d84e3044a9f5515f1/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.546418 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae820b-59cd-4c42-bbfa-9f2e870f48b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da39e06d9364e7592d05d1bac326486, user_id=be6c77aa9db94c4d84e3044a9f5515f1, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:00.549047 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae820b-59cd-4c42-bbfa-9f2e870f48b5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:00.562771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1445/2883] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:28:00 2022] PUT /identity/v3/projects/4da39e06d9364e7592d05d1bac326486/users/be6c77aa9db94c4d84e3044a9f5515f1/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:00.573520 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497493-ed91-4be3-baa5-7b482cd4b01f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.573839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497493-ed91-4be3-baa5-7b482cd4b01f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.574120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497493-ed91-4be3-baa5-7b482cd4b01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.604073 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3f497493-ed91-4be3-baa5-7b482cd4b01f None None] MFA Rules not processed for user `be6c77aa9db94c4d84e3044a9f5515f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:00.605285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3f497493-ed91-4be3-baa5-7b482cd4b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:00.670845 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1439/2884] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:00.682295 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae820b-59cd-4c42-bbfa-9f2e870f48b5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:00.683974 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-85ae820b-59cd-4c42-bbfa-9f2e870f48b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:00.694924 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:00.742221 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae820b-59cd-4c42-bbfa-9f2e870f48b5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:00.745841 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d677c-941a-4b1c-a81b-db9c99aed0fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:00.746439 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d677c-941a-4b1c-a81b-db9c99aed0fe service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:00.746719 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d677c-941a-4b1c-a81b-db9c99aed0fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:00.746993 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d677c-941a-4b1c-a81b-db9c99aed0fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:00.756127 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d677c-941a-4b1c-a81b-db9c99aed0fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:00.757658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d677c-941a-4b1c-a81b-db9c99aed0fe service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:00.766609 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1446/2885] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:28:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:28:03.763524 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497493-ed91-4be3-baa5-7b482cd4b01f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:03.776396 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:03.825814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497493-ed91-4be3-baa5-7b482cd4b01f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:03.830256 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:03.831636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:03.831636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:03.831636 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] PATH_INFO: `/v3/users/be6c77aa9db94c4d84e3044a9f5515f1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:03.832580 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6c77aa9db94c4d84e3044a9f5515f1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:03.834528 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:03.881356 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6c77aa9db94c4d84e3044a9f5515f1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:03.888148 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6c77aa9db94c4d84e3044a9f5515f1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:03.888834 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6c77aa9db94c4d84e3044a9f5515f1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:03.889554 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6c77aa9db94c4d84e3044a9f5515f1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:03.896759 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6c77aa9db94c4d84e3044a9f5515f1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:03.914612 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1440/2886] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:28:03 2022] DELETE /identity/v3/users/be6c77aa9db94c4d84e3044a9f5515f1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:03.919114 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1cde-935b-46ec-97da-d9085a2e15aa None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:03.919599 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1cde-935b-46ec-97da-d9085a2e15aa None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:03.919705 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1cde-935b-46ec-97da-d9085a2e15aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:03.939004 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f81d1cde-935b-46ec-97da-d9085a2e15aa None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:03.940122 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f81d1cde-935b-46ec-97da-d9085a2e15aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:03.997191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1447/2887] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:04.006928 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:04.008306 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:04.066077 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df6c16-a6be-445d-8bb8-5de4328cb2f5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:04.069773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3467349-47c1-433c-902d-7516cde1a106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:04.070370 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3467349-47c1-433c-902d-7516cde1a106 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.070647 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3467349-47c1-433c-902d-7516cde1a106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.070915 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3467349-47c1-433c-902d-7516cde1a106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.079685 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3467349-47c1-433c-902d-7516cde1a106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:04.081089 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3467349-47c1-433c-902d-7516cde1a106 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:04.090371 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1441/2888] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:28:04.361508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1cde-935b-46ec-97da-d9085a2e15aa None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:04.362990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f81d1cde-935b-46ec-97da-d9085a2e15aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:04.377583 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1cde-935b-46ec-97da-d9085a2e15aa None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:04.382652 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:04.383289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.383568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.383839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] PATH_INFO: `/v3/projects/4da39e06d9364e7592d05d1bac326486` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.384977 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da39e06d9364e7592d05d1bac326486)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:04.386929 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:04.434305 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da39e06d9364e7592d05d1bac326486', 'request_id': 'req-7063baf0-f3ea-482f-9c21-73574509b166'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:04.439653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da39e06d9364e7592d05d1bac326486', 'request_id': 'req-7063baf0-f3ea-482f-9c21-73574509b166'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:04.446725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da39e06d9364e7592d05d1bac326486', 'request_id': 'req-7063baf0-f3ea-482f-9c21-73574509b166'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:04.457919 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] The token cache is being invalidate because project 4da39e06d9364e7592d05d1bac326486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:28:04.458203 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:04.458821 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7063baf0-f3ea-482f-9c21-73574509b166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:04.460301 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1448/2889] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:28:04 2022] DELETE /identity/v3/projects/4da39e06d9364e7592d05d1bac326486 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:04.465251 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0835b-8a1d-4893-8532-ded7c486107f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.465474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0835b-8a1d-4893-8532-ded7c486107f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.465785 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0835b-8a1d-4893-8532-ded7c486107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.486083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-77e0835b-8a1d-4893-8532-ded7c486107f None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:04.487737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-77e0835b-8a1d-4893-8532-ded7c486107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:04.518819 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:04.548536 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1442/2890] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:04.556170 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a20855-a4db-4eea-be1d-d8c42d9345f1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.556457 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a20855-a4db-4eea-be1d-d8c42d9345f1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.556733 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a20855-a4db-4eea-be1d-d8c42d9345f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.576625 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-75a20855-a4db-4eea-be1d-d8c42d9345f1 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:04.577853 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-75a20855-a4db-4eea-be1d-d8c42d9345f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:04.586351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1449/2891] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:04.590424 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0835b-8a1d-4893-8532-ded7c486107f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:04.600098 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0835b-8a1d-4893-8532-ded7c486107f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:04.604954 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faac888-c2e3-494c-a7e4-f42f794d9504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:04.605545 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faac888-c2e3-494c-a7e4-f42f794d9504 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.605854 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faac888-c2e3-494c-a7e4-f42f794d9504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.606122 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faac888-c2e3-494c-a7e4-f42f794d9504 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.606758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faac888-c2e3-494c-a7e4-f42f794d9504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:28:04.607057 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faac888-c2e3-494c-a7e4-f42f794d9504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:04.608614 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faac888-c2e3-494c-a7e4-f42f794d9504 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:04.619955 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1443/2892] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:28:04.624356 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a20855-a4db-4eea-be1d-d8c42d9345f1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:04.634340 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a20855-a4db-4eea-be1d-d8c42d9345f1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:04.638972 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da502da-2c35-4982-86ae-cf103fed524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:04.639569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da502da-2c35-4982-86ae-cf103fed524b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.639843 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da502da-2c35-4982-86ae-cf103fed524b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.640113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da502da-2c35-4982-86ae-cf103fed524b admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.640744 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da502da-2c35-4982-86ae-cf103fed524b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:04.642653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da502da-2c35-4982-86ae-cf103fed524b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:04.670191 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1450/2893] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:28:04 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:28:04.674368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faac888-c2e3-494c-a7e4-f42f794d9504 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:04.684778 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faac888-c2e3-494c-a7e4-f42f794d9504 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:04.739076 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fc17a-ffb1-4d24-b5f8-20deee366780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:04.739597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fc17a-ffb1-4d24-b5f8-20deee366780 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.739872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fc17a-ffb1-4d24-b5f8-20deee366780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.740141 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fc17a-ffb1-4d24-b5f8-20deee366780 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.740754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fc17a-ffb1-4d24-b5f8-20deee366780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:04.742662 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fc17a-ffb1-4d24-b5f8-20deee366780 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:04.767340 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1444/2894] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:28:04 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:28:04.769424 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da502da-2c35-4982-86ae-cf103fed524b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:04.779578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da502da-2c35-4982-86ae-cf103fed524b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:04.784155 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff055c-b8ec-4813-a1cc-d093a1877d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:04.784783 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff055c-b8ec-4813-a1cc-d093a1877d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.785057 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff055c-b8ec-4813-a1cc-d093a1877d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.785329 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff055c-b8ec-4813-a1cc-d093a1877d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.786000 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff055c-b8ec-4813-a1cc-d093a1877d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:04.787569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff055c-b8ec-4813-a1cc-d093a1877d66 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:04.788770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:04.799363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1451/2895] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:04.803249 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fc17a-ffb1-4d24-b5f8-20deee366780 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:04.813013 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fc17a-ffb1-4d24-b5f8-20deee366780 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:04.818570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc682a-3a95-4c96-a495-f6284e5696bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:04.819257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc682a-3a95-4c96-a495-f6284e5696bd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.819534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc682a-3a95-4c96-a495-f6284e5696bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.819804 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc682a-3a95-4c96-a495-f6284e5696bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.820438 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc682a-3a95-4c96-a495-f6284e5696bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:04.822042 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc682a-3a95-4c96-a495-f6284e5696bd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:04.833178 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1445/2896] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:04.837364 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff055c-b8ec-4813-a1cc-d093a1877d66 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:04.847612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff055c-b8ec-4813-a1cc-d093a1877d66 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:04.852169 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398cfab-a332-480f-b9b0-5c8c31ef9fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:04.853055 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398cfab-a332-480f-b9b0-5c8c31ef9fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.853334 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398cfab-a332-480f-b9b0-5c8c31ef9fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.853607 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398cfab-a332-480f-b9b0-5c8c31ef9fd6 admin admin] PATH_INFO: `/v3/projects/9cec4ae5373842b99f757c779d84c2a6/users/e96e589db125412794cbeaeab6ae7bb9/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.868369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398cfab-a332-480f-b9b0-5c8c31ef9fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cec4ae5373842b99f757c779d84c2a6, user_id=e96e589db125412794cbeaeab6ae7bb9, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:04.871034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398cfab-a332-480f-b9b0-5c8c31ef9fd6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:04.887727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1452/2897] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:28:04 2022] PUT /identity/v3/projects/9cec4ae5373842b99f757c779d84c2a6/users/e96e589db125412794cbeaeab6ae7bb9/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:04.899088 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008a54a-78fd-4e2d-9f9e-554f0380c4a8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:04.899374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008a54a-78fd-4e2d-9f9e-554f0380c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:04.899648 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008a54a-78fd-4e2d-9f9e-554f0380c4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:04.927053 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9008a54a-78fd-4e2d-9f9e-554f0380c4a8 None None] MFA Rules not processed for user `e96e589db125412794cbeaeab6ae7bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:04.928248 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9008a54a-78fd-4e2d-9f9e-554f0380c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:04.990945 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1446/2898] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:04.995386 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398cfab-a332-480f-b9b0-5c8c31ef9fd6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.056492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398cfab-a332-480f-b9b0-5c8c31ef9fd6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.061067 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e044a-5d68-4d4b-b2d2-4f29abb5e8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.061682 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e044a-5d68-4d4b-b2d2-4f29abb5e8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.061962 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e044a-5d68-4d4b-b2d2-4f29abb5e8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.062231 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e044a-5d68-4d4b-b2d2-4f29abb5e8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.062854 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e044a-5d68-4d4b-b2d2-4f29abb5e8e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.064762 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e044a-5d68-4d4b-b2d2-4f29abb5e8e0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.091768 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1453/2899] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:28:04 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:28:05.095913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008a54a-78fd-4e2d-9f9e-554f0380c4a8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.106876 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008a54a-78fd-4e2d-9f9e-554f0380c4a8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.136402 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:05.163933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91df50d-cd10-4399-b190-d7743de50a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.164540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91df50d-cd10-4399-b190-d7743de50a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.164820 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91df50d-cd10-4399-b190-d7743de50a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.165092 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91df50d-cd10-4399-b190-d7743de50a00 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.165745 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91df50d-cd10-4399-b190-d7743de50a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.167631 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91df50d-cd10-4399-b190-d7743de50a00 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.189020 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1447/2900] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:28:05 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:28:05.194098 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e044a-5d68-4d4b-b2d2-4f29abb5e8e0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.204378 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e044a-5d68-4d4b-b2d2-4f29abb5e8e0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.209789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357f0ef-fee1-4bac-a843-07a27fbd8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.210387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357f0ef-fee1-4bac-a843-07a27fbd8bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.210670 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357f0ef-fee1-4bac-a843-07a27fbd8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.210946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357f0ef-fee1-4bac-a843-07a27fbd8bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.211586 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357f0ef-fee1-4bac-a843-07a27fbd8bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.213174 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357f0ef-fee1-4bac-a843-07a27fbd8bfc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.224234 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1454/2901] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:05.228362 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91df50d-cd10-4399-b190-d7743de50a00 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.238858 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91df50d-cd10-4399-b190-d7743de50a00 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.243562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27f486-9a1a-4beb-b6a0-99dc7ecb1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.244091 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27f486-9a1a-4beb-b6a0-99dc7ecb1735 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.244374 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27f486-9a1a-4beb-b6a0-99dc7ecb1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.244652 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27f486-9a1a-4beb-b6a0-99dc7ecb1735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.245285 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27f486-9a1a-4beb-b6a0-99dc7ecb1735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.246911 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27f486-9a1a-4beb-b6a0-99dc7ecb1735 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.256816 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1448/2902] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:28:05.260706 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357f0ef-fee1-4bac-a843-07a27fbd8bfc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.270814 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357f0ef-fee1-4bac-a843-07a27fbd8bfc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.275459 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24280c48-d3b3-4357-928d-ed8f16bb54ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.276094 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24280c48-d3b3-4357-928d-ed8f16bb54ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.276440 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24280c48-d3b3-4357-928d-ed8f16bb54ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.276721 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24280c48-d3b3-4357-928d-ed8f16bb54ca admin admin] PATH_INFO: `/v3/projects/e63dd6b636f5465489e2be2469914fab/users/a9a98d34b1ee4bb197b84db645bf164c/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.291327 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24280c48-d3b3-4357-928d-ed8f16bb54ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63dd6b636f5465489e2be2469914fab, user_id=a9a98d34b1ee4bb197b84db645bf164c, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.294007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24280c48-d3b3-4357-928d-ed8f16bb54ca admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.306997 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1455/2903] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:28:05 2022] PUT /identity/v3/projects/e63dd6b636f5465489e2be2469914fab/users/a9a98d34b1ee4bb197b84db645bf164c/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:05.317596 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0795a1-48ee-4420-8304-2db4e6d1893d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.317933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0795a1-48ee-4420-8304-2db4e6d1893d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.318235 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0795a1-48ee-4420-8304-2db4e6d1893d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.345973 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cb0795a1-48ee-4420-8304-2db4e6d1893d None None] MFA Rules not processed for user `a9a98d34b1ee4bb197b84db645bf164c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:05.347735 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cb0795a1-48ee-4420-8304-2db4e6d1893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:05.411234 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1449/2904] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:05.415861 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24280c48-d3b3-4357-928d-ed8f16bb54ca admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.477237 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24280c48-d3b3-4357-928d-ed8f16bb54ca admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.482180 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348057e-147e-41e0-8a33-091274b0a81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.482774 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348057e-147e-41e0-8a33-091274b0a81b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.483055 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348057e-147e-41e0-8a33-091274b0a81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.483331 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348057e-147e-41e0-8a33-091274b0a81b admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.483963 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348057e-147e-41e0-8a33-091274b0a81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.485884 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348057e-147e-41e0-8a33-091274b0a81b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.516686 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1456/2905] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:28:05 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:28:05.521170 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0795a1-48ee-4420-8304-2db4e6d1893d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.531728 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0795a1-48ee-4420-8304-2db4e6d1893d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.586991 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d450770-46ae-423d-8f32-b46ddcbe92c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.587597 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450770-46ae-423d-8f32-b46ddcbe92c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.587887 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450770-46ae-423d-8f32-b46ddcbe92c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.588142 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450770-46ae-423d-8f32-b46ddcbe92c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.588766 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d450770-46ae-423d-8f32-b46ddcbe92c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.590696 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d450770-46ae-423d-8f32-b46ddcbe92c1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.612393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1450/2906] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:28:05 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:28:05.616922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348057e-147e-41e0-8a33-091274b0a81b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.627277 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348057e-147e-41e0-8a33-091274b0a81b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.632665 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887f0be-c68a-4ad8-be54-dc2c209e12ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.633251 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887f0be-c68a-4ad8-be54-dc2c209e12ef admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.633526 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887f0be-c68a-4ad8-be54-dc2c209e12ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.633826 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887f0be-c68a-4ad8-be54-dc2c209e12ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.634456 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887f0be-c68a-4ad8-be54-dc2c209e12ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.636029 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887f0be-c68a-4ad8-be54-dc2c209e12ef admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.637214 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:05.648388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1457/2907] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:05.652427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d450770-46ae-423d-8f32-b46ddcbe92c1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.663118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d450770-46ae-423d-8f32-b46ddcbe92c1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.667818 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70506117-d1dc-4733-b729-8efdbfcacb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.668474 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70506117-d1dc-4733-b729-8efdbfcacb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.668758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70506117-d1dc-4733-b729-8efdbfcacb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.669037 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70506117-d1dc-4733-b729-8efdbfcacb7a admin admin] PATH_INFO: `/v3/projects/f5e22cceef064da6834473c9d47dd1e6/users/b713448049b94af1bfbaad3dd5675660/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.684587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70506117-d1dc-4733-b729-8efdbfcacb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e22cceef064da6834473c9d47dd1e6, user_id=b713448049b94af1bfbaad3dd5675660, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.687267 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70506117-d1dc-4733-b729-8efdbfcacb7a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.700080 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1451/2908] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:28:05 2022] PUT /identity/v3/projects/f5e22cceef064da6834473c9d47dd1e6/users/b713448049b94af1bfbaad3dd5675660/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:05.704192 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887f0be-c68a-4ad8-be54-dc2c209e12ef admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.714836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887f0be-c68a-4ad8-be54-dc2c209e12ef admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.770709 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d02ce5-94f3-4e5a-b841-43d0cdff1501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.771244 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d02ce5-94f3-4e5a-b841-43d0cdff1501 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.771527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d02ce5-94f3-4e5a-b841-43d0cdff1501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.771803 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d02ce5-94f3-4e5a-b841-43d0cdff1501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.772437 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d02ce5-94f3-4e5a-b841-43d0cdff1501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.774062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d02ce5-94f3-4e5a-b841-43d0cdff1501 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.783510 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1458/2909] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:05.788262 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70506117-d1dc-4733-b729-8efdbfcacb7a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.795028 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:05.798899 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70506117-d1dc-4733-b729-8efdbfcacb7a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:05.804689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1047b-506a-4ba7-9794-8ca4ddd97ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:05.805373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1047b-506a-4ba7-9794-8ca4ddd97ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.805659 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1047b-506a-4ba7-9794-8ca4ddd97ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.805940 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1047b-506a-4ba7-9794-8ca4ddd97ff4 admin admin] PATH_INFO: `/v3/projects/f5e22cceef064da6834473c9d47dd1e6/users/b713448049b94af1bfbaad3dd5675660/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.807881 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1047b-506a-4ba7-9794-8ca4ddd97ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e22cceef064da6834473c9d47dd1e6, user_id=b713448049b94af1bfbaad3dd5675660, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:05.810496 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1047b-506a-4ba7-9794-8ca4ddd97ff4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:05.820667 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1452/2910] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:28:05 2022] PUT /identity/v3/projects/f5e22cceef064da6834473c9d47dd1e6/users/b713448049b94af1bfbaad3dd5675660/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:05.830751 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dfcc5-ab21-468b-a5d9-445beccc291a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:05.831046 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dfcc5-ab21-468b-a5d9-445beccc291a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:05.831990 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dfcc5-ab21-468b-a5d9-445beccc291a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:05.861634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c34dfcc5-ab21-468b-a5d9-445beccc291a None None] MFA Rules not processed for user `b713448049b94af1bfbaad3dd5675660`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:05.862908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c34dfcc5-ab21-468b-a5d9-445beccc291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:05.945476 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1459/2911] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:05.956959 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1047b-506a-4ba7-9794-8ca4ddd97ff4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:05.958688 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-83c1047b-506a-4ba7-9794-8ca4ddd97ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:06.016335 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1047b-506a-4ba7-9794-8ca4ddd97ff4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:06.020893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865249f4-6b3d-4d42-a6c9-1dbb59288c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:06.021432 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865249f4-6b3d-4d42-a6c9-1dbb59288c89 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:06.021741 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865249f4-6b3d-4d42-a6c9-1dbb59288c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:06.022018 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865249f4-6b3d-4d42-a6c9-1dbb59288c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:06.078873 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865249f4-6b3d-4d42-a6c9-1dbb59288c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:06.080304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865249f4-6b3d-4d42-a6c9-1dbb59288c89 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:06.090382 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1453/2912] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:28:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:28:07.596018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dfcc5-ab21-468b-a5d9-445beccc291a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:07.597610 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c34dfcc5-ab21-468b-a5d9-445beccc291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:07.609876 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dfcc5-ab21-468b-a5d9-445beccc291a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:07.613534 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17edc8f-61f6-45e6-80d1-b515c2846de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:07.614162 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17edc8f-61f6-45e6-80d1-b515c2846de2 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:07.614441 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17edc8f-61f6-45e6-80d1-b515c2846de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:07.614712 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17edc8f-61f6-45e6-80d1-b515c2846de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:07.671731 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17edc8f-61f6-45e6-80d1-b515c2846de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:07.673086 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17edc8f-61f6-45e6-80d1-b515c2846de2 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:07.682168 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1460/2913] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:28:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:28:08.198711 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865249f4-6b3d-4d42-a6c9-1dbb59288c89 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:08.207302 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865249f4-6b3d-4d42-a6c9-1dbb59288c89 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:08.211118 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bb216-86e3-4f63-bcc8-5b66a7478996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:08.211713 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bb216-86e3-4f63-bcc8-5b66a7478996 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:08.211987 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bb216-86e3-4f63-bcc8-5b66a7478996 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:08.212254 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bb216-86e3-4f63-bcc8-5b66a7478996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:08.221224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bb216-86e3-4f63-bcc8-5b66a7478996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:08.223152 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bb216-86e3-4f63-bcc8-5b66a7478996 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:08.232837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1454/2914] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:28:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:28:12.105867 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17edc8f-61f6-45e6-80d1-b515c2846de2 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:12.123579 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:12.170448 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17edc8f-61f6-45e6-80d1-b515c2846de2 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:12.175013 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:12.175634 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:12.176056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:12.176578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] PATH_INFO: `/v3/users/e96e589db125412794cbeaeab6ae7bb9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:12.177764 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96e589db125412794cbeaeab6ae7bb9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:12.179689 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:12.226426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96e589db125412794cbeaeab6ae7bb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.234021 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96e589db125412794cbeaeab6ae7bb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.234710 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96e589db125412794cbeaeab6ae7bb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.235426 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96e589db125412794cbeaeab6ae7bb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.242548 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96e589db125412794cbeaeab6ae7bb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.259760 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1461/2915] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:28:12 2022] DELETE /identity/v3/users/e96e589db125412794cbeaeab6ae7bb9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:12.264263 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb29886-6a52-4929-895a-a9152e37a743 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:12.264715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb29886-6a52-4929-895a-a9152e37a743 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:12.264837 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb29886-6a52-4929-895a-a9152e37a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:12.283906 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-adb29886-6a52-4929-895a-a9152e37a743 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:12.285079 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-adb29886-6a52-4929-895a-a9152e37a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:12.346599 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1455/2916] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:12.356568 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:12.358051 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:12.417452 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776875a-35aa-43fc-804d-ae6512e0f09d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:12.421146 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789f474-19c6-4a20-81d2-2ec1e01692c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:12.421787 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789f474-19c6-4a20-81d2-2ec1e01692c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:12.422077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789f474-19c6-4a20-81d2-2ec1e01692c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:12.422350 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789f474-19c6-4a20-81d2-2ec1e01692c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:12.432233 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789f474-19c6-4a20-81d2-2ec1e01692c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:12.433691 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789f474-19c6-4a20-81d2-2ec1e01692c6 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:12.443987 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1462/2917] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:28:12.714740 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb29886-6a52-4929-895a-a9152e37a743 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:12.716245 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-adb29886-6a52-4929-895a-a9152e37a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:12.729880 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb29886-6a52-4929-895a-a9152e37a743 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:12.735244 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:12.735967 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:12.736317 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:12.736594 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] PATH_INFO: `/v3/projects/9cec4ae5373842b99f757c779d84c2a6` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:12.737754 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cec4ae5373842b99f757c779d84c2a6)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:12.739660 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:12.773933 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:12.791924 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cec4ae5373842b99f757c779d84c2a6', 'request_id': 'req-cb589db2-731f-4f74-8359-f8cfadf3a8a9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.799332 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cec4ae5373842b99f757c779d84c2a6', 'request_id': 'req-cb589db2-731f-4f74-8359-f8cfadf3a8a9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.805727 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cec4ae5373842b99f757c779d84c2a6', 'request_id': 'req-cb589db2-731f-4f74-8359-f8cfadf3a8a9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.816634 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] The token cache is being invalidate because project 9cec4ae5373842b99f757c779d84c2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:28:12.816922 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.817555 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.819114 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1456/2918] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:28:12 2022] DELETE /identity/v3/projects/9cec4ae5373842b99f757c779d84c2a6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:12.823188 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789f474-19c6-4a20-81d2-2ec1e01692c6 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:12.832864 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789f474-19c6-4a20-81d2-2ec1e01692c6 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:12.867750 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:12.891766 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:12.892332 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:12.892612 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:12.892888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] PATH_INFO: `/v3/users/a9a98d34b1ee4bb197b84db645bf164c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:12.894031 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a98d34b1ee4bb197b84db645bf164c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:12.895933 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:12.940587 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a98d34b1ee4bb197b84db645bf164c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.947780 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a98d34b1ee4bb197b84db645bf164c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.948467 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a98d34b1ee4bb197b84db645bf164c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.949095 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a98d34b1ee4bb197b84db645bf164c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.956246 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a98d34b1ee4bb197b84db645bf164c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:12.973595 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1463/2919] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:28:12 2022] DELETE /identity/v3/users/a9a98d34b1ee4bb197b84db645bf164c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:13.245872 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:13.247351 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:13.260390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb589db2-731f-4f74-8359-f8cfadf3a8a9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:13.324224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:13.324937 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:13.325138 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:13.325413 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] PATH_INFO: `/v3/projects/e63dd6b636f5465489e2be2469914fab` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:13.326611 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63dd6b636f5465489e2be2469914fab)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:13.328509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:13.375623 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63dd6b636f5465489e2be2469914fab', 'request_id': 'req-f8030575-39d3-4db6-8152-adebb5fbd7d5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.382085 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63dd6b636f5465489e2be2469914fab', 'request_id': 'req-f8030575-39d3-4db6-8152-adebb5fbd7d5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.389010 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63dd6b636f5465489e2be2469914fab', 'request_id': 'req-f8030575-39d3-4db6-8152-adebb5fbd7d5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.400814 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] The token cache is being invalidate because project e63dd6b636f5465489e2be2469914fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:28:13.401099 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.401823 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.403368 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1457/2920] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:28:13 2022] DELETE /identity/v3/projects/e63dd6b636f5465489e2be2469914fab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:13.407501 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:13.408918 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:13.421946 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444233e-5814-4ab6-95a7-2dea87b720e2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:13.476464 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:13.477083 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:13.477423 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:13.477978 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] PATH_INFO: `/v3/users/b713448049b94af1bfbaad3dd5675660` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:13.479085 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b713448049b94af1bfbaad3dd5675660)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:13.481010 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:13.525309 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b713448049b94af1bfbaad3dd5675660'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.532542 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b713448049b94af1bfbaad3dd5675660'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.533158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b713448049b94af1bfbaad3dd5675660'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.533798 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b713448049b94af1bfbaad3dd5675660'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.538363 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:13.542117 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b700e8db-2dd0-45ac-99e5-9df0807449a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b713448049b94af1bfbaad3dd5675660'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.561038 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1464/2921] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:28:13 2022] DELETE /identity/v3/users/b713448049b94af1bfbaad3dd5675660 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:13.833150 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:13.834617 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:13.847760 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8030575-39d3-4db6-8152-adebb5fbd7d5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:13.893257 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:13.907534 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:13.908168 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:13.908445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:13.908715 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] PATH_INFO: `/v3/projects/f5e22cceef064da6834473c9d47dd1e6` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:13.909849 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e22cceef064da6834473c9d47dd1e6)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:13.912693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:13.967693 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e22cceef064da6834473c9d47dd1e6', 'request_id': 'req-8351277d-357a-4dd3-a865-f0076e8f871e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.974571 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e22cceef064da6834473c9d47dd1e6', 'request_id': 'req-8351277d-357a-4dd3-a865-f0076e8f871e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.981540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e22cceef064da6834473c9d47dd1e6', 'request_id': 'req-8351277d-357a-4dd3-a865-f0076e8f871e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.993214 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] The token cache is being invalidate because project f5e22cceef064da6834473c9d47dd1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:28:13.993570 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.994307 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8351277d-357a-4dd3-a865-f0076e8f871e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:13.995805 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1458/2922] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:28:13 2022] DELETE /identity/v3/projects/f5e22cceef064da6834473c9d47dd1e6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:14.000661 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818ce73-0e27-469c-b96f-f6823792eeab None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.000948 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818ce73-0e27-469c-b96f-f6823792eeab None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.001218 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818ce73-0e27-469c-b96f-f6823792eeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.021351 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4818ce73-0e27-469c-b96f-f6823792eeab None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:14.022578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4818ce73-0e27-469c-b96f-f6823792eeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:14.084014 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1465/2923] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:28:14.091957 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a980a-31d6-46c0-98e5-59237474a6a5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.092246 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a980a-31d6-46c0-98e5-59237474a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.092526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a980a-31d6-46c0-98e5-59237474a6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.112221 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9b3a980a-31d6-46c0-98e5-59237474a6a5 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:14.113412 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9b3a980a-31d6-46c0-98e5-59237474a6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:14.122110 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1459/2924] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:14.126220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818ce73-0e27-469c-b96f-f6823792eeab None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.136369 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818ce73-0e27-469c-b96f-f6823792eeab None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.140912 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7db602-74ab-401c-b990-95adb067de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.141496 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7db602-74ab-401c-b990-95adb067de7a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.141805 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7db602-74ab-401c-b990-95adb067de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.142075 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7db602-74ab-401c-b990-95adb067de7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.142708 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7db602-74ab-401c-b990-95adb067de7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:28:14.143007 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7db602-74ab-401c-b990-95adb067de7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.144582 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7db602-74ab-401c-b990-95adb067de7a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.155973 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1466/2925] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 19 12:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:28:14.160187 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a980a-31d6-46c0-98e5-59237474a6a5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.170083 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a980a-31d6-46c0-98e5-59237474a6a5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.174702 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9698d-3ae4-45c1-bb28-64ffa9182d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.175304 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9698d-3ae4-45c1-bb28-64ffa9182d4d admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.175644 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9698d-3ae4-45c1-bb28-64ffa9182d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.175844 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9698d-3ae4-45c1-bb28-64ffa9182d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.176473 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9698d-3ae4-45c1-bb28-64ffa9182d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.178400 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9698d-3ae4-45c1-bb28-64ffa9182d4d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.206519 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1460/2926] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:28:14 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:28:14.210725 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7db602-74ab-401c-b990-95adb067de7a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.220527 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7db602-74ab-401c-b990-95adb067de7a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.292347 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3047d02-e8f1-407c-89a9-c39c43f69af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.292956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3047d02-e8f1-407c-89a9-c39c43f69af5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.293235 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3047d02-e8f1-407c-89a9-c39c43f69af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.293507 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3047d02-e8f1-407c-89a9-c39c43f69af5 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.294289 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3047d02-e8f1-407c-89a9-c39c43f69af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.296200 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3047d02-e8f1-407c-89a9-c39c43f69af5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.316062 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1467/2927] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:28:14 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:28:14.320241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9698d-3ae4-45c1-bb28-64ffa9182d4d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.330454 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9698d-3ae4-45c1-bb28-64ffa9182d4d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.334966 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f35e9-ec96-4c7a-ab55-d8ce7aec6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.335562 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f35e9-ec96-4c7a-ab55-d8ce7aec6eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.335908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f35e9-ec96-4c7a-ab55-d8ce7aec6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.336194 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f35e9-ec96-4c7a-ab55-d8ce7aec6eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.336828 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f35e9-ec96-4c7a-ab55-d8ce7aec6eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.338427 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f35e9-ec96-4c7a-ab55-d8ce7aec6eb5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.348277 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1461/2928] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:14.352879 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3047d02-e8f1-407c-89a9-c39c43f69af5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.362956 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3047d02-e8f1-407c-89a9-c39c43f69af5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.368096 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b630c-8777-4e21-a261-aaa656bc5acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.368684 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b630c-8777-4e21-a261-aaa656bc5acb admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.368965 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b630c-8777-4e21-a261-aaa656bc5acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.369269 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b630c-8777-4e21-a261-aaa656bc5acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.369932 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b630c-8777-4e21-a261-aaa656bc5acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.371508 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b630c-8777-4e21-a261-aaa656bc5acb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.381908 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1468/2929] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:28:14.385829 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f35e9-ec96-4c7a-ab55-d8ce7aec6eb5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.395838 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f35e9-ec96-4c7a-ab55-d8ce7aec6eb5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.400540 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b9dd5-f772-491e-a848-6af039d4deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.401204 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b9dd5-f772-491e-a848-6af039d4deec admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.401485 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b9dd5-f772-491e-a848-6af039d4deec admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.401796 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b9dd5-f772-491e-a848-6af039d4deec admin admin] PATH_INFO: `/v3/projects/6388a5c08a2541bdb23f12416fe57f57/users/ae35d3d2005c42f599ba1f405beabb48/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.419292 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b9dd5-f772-491e-a848-6af039d4deec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6388a5c08a2541bdb23f12416fe57f57, user_id=ae35d3d2005c42f599ba1f405beabb48, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.422065 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b9dd5-f772-491e-a848-6af039d4deec admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.435135 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1462/2930] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:28:14 2022] PUT /identity/v3/projects/6388a5c08a2541bdb23f12416fe57f57/users/ae35d3d2005c42f599ba1f405beabb48/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:14.445552 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1ebc-31ce-42a8-b334-e4fa6ce46642 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.446080 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1ebc-31ce-42a8-b334-e4fa6ce46642 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.446182 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1ebc-31ce-42a8-b334-e4fa6ce46642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.472600 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2daa1ebc-31ce-42a8-b334-e4fa6ce46642 None None] MFA Rules not processed for user `ae35d3d2005c42f599ba1f405beabb48`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:14.473775 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2daa1ebc-31ce-42a8-b334-e4fa6ce46642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:14.504294 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:14.539726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1469/2931] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:14.544240 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b9dd5-f772-491e-a848-6af039d4deec admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.603811 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b9dd5-f772-491e-a848-6af039d4deec admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.608401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf980e-5a89-43ba-841c-69249669b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.608996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf980e-5a89-43ba-841c-69249669b68e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.609271 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf980e-5a89-43ba-841c-69249669b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.609538 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf980e-5a89-43ba-841c-69249669b68e admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.610193 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf980e-5a89-43ba-841c-69249669b68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.612058 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf980e-5a89-43ba-841c-69249669b68e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.631093 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:14.642834 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1463/2932] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:28:14 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:28:14.643976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa1ebc-31ce-42a8-b334-e4fa6ce46642 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.654881 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa1ebc-31ce-42a8-b334-e4fa6ce46642 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.712741 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaab178-1a79-4289-a6c4-10de7926e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.713340 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaab178-1a79-4289-a6c4-10de7926e3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.713643 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaab178-1a79-4289-a6c4-10de7926e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.713926 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaab178-1a79-4289-a6c4-10de7926e3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.714555 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaab178-1a79-4289-a6c4-10de7926e3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.716523 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaab178-1a79-4289-a6c4-10de7926e3f8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.737851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1470/2933] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:28:14 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:28:14.741917 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf980e-5a89-43ba-841c-69249669b68e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.752405 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf980e-5a89-43ba-841c-69249669b68e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.756962 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a562e-0b8c-42ed-a98a-ae9ed5bfb0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.757568 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a562e-0b8c-42ed-a98a-ae9ed5bfb0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.757894 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a562e-0b8c-42ed-a98a-ae9ed5bfb0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.758166 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a562e-0b8c-42ed-a98a-ae9ed5bfb0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.758802 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a562e-0b8c-42ed-a98a-ae9ed5bfb0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.760375 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a562e-0b8c-42ed-a98a-ae9ed5bfb0eb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.770686 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1464/2934] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:14.775123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaab178-1a79-4289-a6c4-10de7926e3f8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.784851 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaab178-1a79-4289-a6c4-10de7926e3f8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.790092 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348c77f-756e-4632-9549-88857e1a41cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.790680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c77f-756e-4632-9549-88857e1a41cd admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.790959 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c77f-756e-4632-9549-88857e1a41cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.791227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c77f-756e-4632-9549-88857e1a41cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.791888 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348c77f-756e-4632-9549-88857e1a41cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.793559 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348c77f-756e-4632-9549-88857e1a41cd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.803382 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1471/2935] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:14.807404 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a562e-0b8c-42ed-a98a-ae9ed5bfb0eb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:14.817075 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a562e-0b8c-42ed-a98a-ae9ed5bfb0eb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:14.821758 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9a445-fe28-40f7-9a3d-437314c09e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:14.822390 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9a445-fe28-40f7-9a3d-437314c09e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.822668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9a445-fe28-40f7-9a3d-437314c09e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.822939 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9a445-fe28-40f7-9a3d-437314c09e48 admin admin] PATH_INFO: `/v3/projects/1bcc5ecbe01c4847a651bf6958a7dadf/users/c093a302cdd0401392a3a08825c8b42a/roles/b320236412e649d9ab1e6787ef8a6870` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.837464 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9a445-fe28-40f7-9a3d-437314c09e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcc5ecbe01c4847a651bf6958a7dadf, user_id=c093a302cdd0401392a3a08825c8b42a, role_id=b320236412e649d9ab1e6787ef8a6870)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:14.840120 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9a445-fe28-40f7-9a3d-437314c09e48 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:14.853472 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1465/2936] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:28:14 2022] PUT /identity/v3/projects/1bcc5ecbe01c4847a651bf6958a7dadf/users/c093a302cdd0401392a3a08825c8b42a/roles/b320236412e649d9ab1e6787ef8a6870 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:28:14.864276 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f770319-8943-4b75-8f9e-ce3653a20834 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:14.864590 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f770319-8943-4b75-8f9e-ce3653a20834 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:14.864863 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f770319-8943-4b75-8f9e-ce3653a20834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:14.892695 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8f770319-8943-4b75-8f9e-ce3653a20834 None None] MFA Rules not processed for user `c093a302cdd0401392a3a08825c8b42a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:14.893922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8f770319-8943-4b75-8f9e-ce3653a20834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:14.957420 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1472/2937] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:14.962767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9a445-fe28-40f7-9a3d-437314c09e48 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:15.024201 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9a445-fe28-40f7-9a3d-437314c09e48 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:15.028773 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2970f5-3a3d-4e9c-9796-24f30591a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:15.029373 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2970f5-3a3d-4e9c-9796-24f30591a5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:15.029677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2970f5-3a3d-4e9c-9796-24f30591a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:15.029956 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2970f5-3a3d-4e9c-9796-24f30591a5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:15.030622 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2970f5-3a3d-4e9c-9796-24f30591a5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:15.032500 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2970f5-3a3d-4e9c-9796-24f30591a5a4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:15.058155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1466/2938] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 19 12:28:14 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:28:15.062227 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f770319-8943-4b75-8f9e-ce3653a20834 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:15.073402 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f770319-8943-4b75-8f9e-ce3653a20834 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:15.110697 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:15.130105 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3a080-20de-49be-b6d6-498b377ad5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:15.130711 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3a080-20de-49be-b6d6-498b377ad5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:15.130991 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3a080-20de-49be-b6d6-498b377ad5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:15.131286 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3a080-20de-49be-b6d6-498b377ad5f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:15.131890 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3a080-20de-49be-b6d6-498b377ad5f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:15.134421 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3a080-20de-49be-b6d6-498b377ad5f7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:15.155413 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1473/2939] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 19 12:28:15 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:28:15.159369 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2970f5-3a3d-4e9c-9796-24f30591a5a4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:15.169668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2970f5-3a3d-4e9c-9796-24f30591a5a4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:15.174126 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60581783-8e1e-46e7-b85b-8105a6c80e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:15.174720 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60581783-8e1e-46e7-b85b-8105a6c80e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:15.174996 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60581783-8e1e-46e7-b85b-8105a6c80e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:15.175268 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60581783-8e1e-46e7-b85b-8105a6c80e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:15.175897 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60581783-8e1e-46e7-b85b-8105a6c80e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:15.177460 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60581783-8e1e-46e7-b85b-8105a6c80e10 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:15.187733 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1467/2940] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:15.191909 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3a080-20de-49be-b6d6-498b377ad5f7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:15.202617 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3a080-20de-49be-b6d6-498b377ad5f7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:15.207199 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e8a9d-6a1e-4663-a328-f59d9224f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:15.207837 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e8a9d-6a1e-4663-a328-f59d9224f7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:15.208123 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e8a9d-6a1e-4663-a328-f59d9224f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:15.208396 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e8a9d-6a1e-4663-a328-f59d9224f7f2 admin admin] PATH_INFO: `/v3/projects/c547d76e912044d0b6e1152fc0a85753/users/268d615f41b2454e97403385b28ccbb7/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:15.223547 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e8a9d-6a1e-4663-a328-f59d9224f7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c547d76e912044d0b6e1152fc0a85753, user_id=268d615f41b2454e97403385b28ccbb7, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:15.226468 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e8a9d-6a1e-4663-a328-f59d9224f7f2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:15.239054 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1474/2941] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:28:15 2022] PUT /identity/v3/projects/c547d76e912044d0b6e1152fc0a85753/users/268d615f41b2454e97403385b28ccbb7/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:28:15.243442 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60581783-8e1e-46e7-b85b-8105a6c80e10 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:15.253162 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60581783-8e1e-46e7-b85b-8105a6c80e10 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:15.308551 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b6c6-9683-4b72-bc4d-e48c1bc3d508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:15.309167 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b6c6-9683-4b72-bc4d-e48c1bc3d508 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:15.309447 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b6c6-9683-4b72-bc4d-e48c1bc3d508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:15.309747 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b6c6-9683-4b72-bc4d-e48c1bc3d508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:15.310384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52b6c6-9683-4b72-bc4d-e48c1bc3d508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:15.311998 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52b6c6-9683-4b72-bc4d-e48c1bc3d508 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:15.322539 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1468/2942] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 19 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:28:15.326767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e8a9d-6a1e-4663-a328-f59d9224f7f2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:15.336836 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e8a9d-6a1e-4663-a328-f59d9224f7f2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:15.341653 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc1e8d-748b-4716-8608-5e296073366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:15.342292 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc1e8d-748b-4716-8608-5e296073366a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:15.342566 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc1e8d-748b-4716-8608-5e296073366a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:15.342839 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc1e8d-748b-4716-8608-5e296073366a admin admin] PATH_INFO: `/v3/projects/c547d76e912044d0b6e1152fc0a85753/users/268d615f41b2454e97403385b28ccbb7/roles/89abb13ee1e6498fa969c4a4f0332ba9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:15.344730 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc1e8d-748b-4716-8608-5e296073366a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c547d76e912044d0b6e1152fc0a85753, user_id=268d615f41b2454e97403385b28ccbb7, role_id=89abb13ee1e6498fa969c4a4f0332ba9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:15.347360 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc1e8d-748b-4716-8608-5e296073366a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:15.357767 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1475/2943] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 19 12:28:15 2022] PUT /identity/v3/projects/c547d76e912044d0b6e1152fc0a85753/users/268d615f41b2454e97403385b28ccbb7/roles/89abb13ee1e6498fa969c4a4f0332ba9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:15.369030 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c4b6-9516-4af0-827a-cc90dce5bd42 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:15.369512 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c4b6-9516-4af0-827a-cc90dce5bd42 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:15.369691 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c4b6-9516-4af0-827a-cc90dce5bd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:15.399339 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-56b4c4b6-9516-4af0-827a-cc90dce5bd42 None None] MFA Rules not processed for user `268d615f41b2454e97403385b28ccbb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:15.400526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-56b4c4b6-9516-4af0-827a-cc90dce5bd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:15.421155 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:15.470379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1469/2944] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:15.481913 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc1e8d-748b-4716-8608-5e296073366a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:15.483640 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ddc1e8d-748b-4716-8608-5e296073366a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:15.543113 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc1e8d-748b-4716-8608-5e296073366a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:15.546727 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c320b7-7409-4f29-8d04-a49cbd69f34d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:15.547330 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c320b7-7409-4f29-8d04-a49cbd69f34d service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:15.547605 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c320b7-7409-4f29-8d04-a49cbd69f34d service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:15.547874 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c320b7-7409-4f29-8d04-a49cbd69f34d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:15.604077 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c320b7-7409-4f29-8d04-a49cbd69f34d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:15.606091 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c320b7-7409-4f29-8d04-a49cbd69f34d service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:15.616034 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1476/2945] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:28:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:28:17.146643 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4c4b6-9516-4af0-827a-cc90dce5bd42 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:17.148129 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-56b4c4b6-9516-4af0-827a-cc90dce5bd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:17.159958 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4c4b6-9516-4af0-827a-cc90dce5bd42 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:17.164259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931c0ee-9d1a-426b-8fb7-bdb540ba3347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:17.164851 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931c0ee-9d1a-426b-8fb7-bdb540ba3347 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:17.165130 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931c0ee-9d1a-426b-8fb7-bdb540ba3347 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:17.165401 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931c0ee-9d1a-426b-8fb7-bdb540ba3347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:17.220175 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931c0ee-9d1a-426b-8fb7-bdb540ba3347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:17.221526 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931c0ee-9d1a-426b-8fb7-bdb540ba3347 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:17.231238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1470/2946] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:28:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:28:17.748726 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c320b7-7409-4f29-8d04-a49cbd69f34d service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:17.757372 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c320b7-7409-4f29-8d04-a49cbd69f34d service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:17.761006 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6db61-ed47-4d9f-af63-cff5bcf98df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9cdd3fefd3f44eeaf19adbfac1ea13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:17.761644 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6db61-ed47-4d9f-af63-cff5bcf98df5 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:17.761930 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6db61-ed47-4d9f-af63-cff5bcf98df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:17.762220 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6db61-ed47-4d9f-af63-cff5bcf98df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:17.770922 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6db61-ed47-4d9f-af63-cff5bcf98df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:17.772355 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6db61-ed47-4d9f-af63-cff5bcf98df5 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:17.782145 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1477/2947] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:28:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:28:21.654123 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931c0ee-9d1a-426b-8fb7-bdb540ba3347 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:21.722905 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931c0ee-9d1a-426b-8fb7-bdb540ba3347 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:21.727379 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:21.728756 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:21.729032 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:21.729303 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] PATH_INFO: `/v3/users/ae35d3d2005c42f599ba1f405beabb48` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:21.730430 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae35d3d2005c42f599ba1f405beabb48)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:21.732677 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:21.778108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae35d3d2005c42f599ba1f405beabb48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:21.785172 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae35d3d2005c42f599ba1f405beabb48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:21.785866 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae35d3d2005c42f599ba1f405beabb48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:21.786462 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae35d3d2005c42f599ba1f405beabb48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:21.791587 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:21.794573 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae35d3d2005c42f599ba1f405beabb48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:21.813668 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1471/2948] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:28:21 2022] DELETE /identity/v3/users/ae35d3d2005c42f599ba1f405beabb48 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:21.818153 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48be599-6a5c-4b72-b741-cd47716e51d0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:21.818658 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48be599-6a5c-4b72-b741-cd47716e51d0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:21.818770 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48be599-6a5c-4b72-b741-cd47716e51d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:21.837549 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f48be599-6a5c-4b72-b741-cd47716e51d0 None None] MFA Rules not processed for user `42e8360255b24c6f83e6dd2dd021babf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:28:21.838771 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f48be599-6a5c-4b72-b741-cd47716e51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:21.867478 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:21.899101 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1478/2949] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 19 12:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:28:21.909029 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:21.910449 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:21.974913 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d61b8f-3a7b-4a88-9c07-0061823ab402 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:21.981889 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746b542-75a4-4446-bc5b-32f991bc808e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe0dabaf0ef4fc7b417d378334413c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:21.982929 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b542-75a4-4446-bc5b-32f991bc808e service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:21.983418 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b542-75a4-4446-bc5b-32f991bc808e service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:21.983910 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b542-75a4-4446-bc5b-32f991bc808e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:21.997521 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746b542-75a4-4446-bc5b-32f991bc808e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:21.999635 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746b542-75a4-4446-bc5b-32f991bc808e service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:22.008883 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1472/2950] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:28:22.276809 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48be599-6a5c-4b72-b741-cd47716e51d0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:22.278288 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f48be599-6a5c-4b72-b741-cd47716e51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:22.291109 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48be599-6a5c-4b72-b741-cd47716e51d0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:22.296672 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:22.297342 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:22.297636 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:22.298018 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] PATH_INFO: `/v3/projects/6388a5c08a2541bdb23f12416fe57f57` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:22.300068 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6388a5c08a2541bdb23f12416fe57f57)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:22.302037 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:22.349657 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6388a5c08a2541bdb23f12416fe57f57', 'request_id': 'req-23fd2f26-7ec9-4819-b078-e19c37175878'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.355543 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6388a5c08a2541bdb23f12416fe57f57', 'request_id': 'req-23fd2f26-7ec9-4819-b078-e19c37175878'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.362680 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6388a5c08a2541bdb23f12416fe57f57', 'request_id': 'req-23fd2f26-7ec9-4819-b078-e19c37175878'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.373551 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] The token cache is being invalidate because project 6388a5c08a2541bdb23f12416fe57f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:28:22.373866 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.374491 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.375958 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1479/2951] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:28:22 2022] DELETE /identity/v3/projects/6388a5c08a2541bdb23f12416fe57f57 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:22.379893 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746b542-75a4-4446-bc5b-32f991bc808e service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:22.389865 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746b542-75a4-4446-bc5b-32f991bc808e service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:22.444748 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:22.445384 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:22.445701 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:22.445982 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] PATH_INFO: `/v3/users/c093a302cdd0401392a3a08825c8b42a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:22.447615 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c093a302cdd0401392a3a08825c8b42a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:22.449556 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:22.495908 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c093a302cdd0401392a3a08825c8b42a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.503492 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c093a302cdd0401392a3a08825c8b42a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.504259 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c093a302cdd0401392a3a08825c8b42a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.504990 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c093a302cdd0401392a3a08825c8b42a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.512952 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c093a302cdd0401392a3a08825c8b42a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.526588 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:22.533767 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1473/2952] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:28:22 2022] DELETE /identity/v3/users/c093a302cdd0401392a3a08825c8b42a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:22.811540 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:22.812969 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:22.827388 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd2f26-7ec9-4819-b078-e19c37175878 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:22.886678 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:22.887242 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:22.887537 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:22.887820 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] PATH_INFO: `/v3/projects/1bcc5ecbe01c4847a651bf6958a7dadf` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:22.888988 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bcc5ecbe01c4847a651bf6958a7dadf)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:22.891072 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:22.937578 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bcc5ecbe01c4847a651bf6958a7dadf', 'request_id': 'req-fc54c1c9-03b2-411b-b881-8a82eb368716'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.943154 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bcc5ecbe01c4847a651bf6958a7dadf', 'request_id': 'req-fc54c1c9-03b2-411b-b881-8a82eb368716'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.944789 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:22.951858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bcc5ecbe01c4847a651bf6958a7dadf', 'request_id': 'req-fc54c1c9-03b2-411b-b881-8a82eb368716'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.964143 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] The token cache is being invalidate because project 1bcc5ecbe01c4847a651bf6958a7dadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:28:22.964431 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.965074 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:22.966687 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1480/2953] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:28:22 2022] DELETE /identity/v3/projects/1bcc5ecbe01c4847a651bf6958a7dadf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:22.970737 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:22.972224 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:22.985445 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ede3ed-299a-45f8-9dcb-328ce813c87c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:23.040868 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:23.042005 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:23.042283 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:23.042553 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] PATH_INFO: `/v3/users/268d615f41b2454e97403385b28ccbb7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:23.043732 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=268d615f41b2454e97403385b28ccbb7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:23.045698 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:23.090544 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268d615f41b2454e97403385b28ccbb7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:23.097578 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268d615f41b2454e97403385b28ccbb7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:23.098238 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268d615f41b2454e97403385b28ccbb7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:23.098839 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268d615f41b2454e97403385b28ccbb7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:23.106033 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268d615f41b2454e97403385b28ccbb7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:23.124502 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1474/2954] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 19 12:28:22 2022] DELETE /identity/v3/users/268d615f41b2454e97403385b28ccbb7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:23.403158 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:28:23.404557 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:28:23.418103 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54c1c9-03b2-411b-b881-8a82eb368716 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:28:23.474858 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42e8360255b24c6f83e6dd2dd021babf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bb369f1514f798528db70a760243b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:28:23.475492 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:28:23.475778 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:28:23.476056 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] PATH_INFO: `/v3/projects/c547d76e912044d0b6e1152fc0a85753` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:28:23.477264 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c547d76e912044d0b6e1152fc0a85753)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:28:23.479498 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:28:23.528387 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c547d76e912044d0b6e1152fc0a85753', 'request_id': 'req-5e47b130-f911-46dd-9804-7aad11e06814'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:23.534125 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c547d76e912044d0b6e1152fc0a85753', 'request_id': 'req-5e47b130-f911-46dd-9804-7aad11e06814'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:23.542247 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c547d76e912044d0b6e1152fc0a85753', 'request_id': 'req-5e47b130-f911-46dd-9804-7aad11e06814'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:23.553976 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] The token cache is being invalidate because project c547d76e912044d0b6e1152fc0a85753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:28:23.554259 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:23.554900 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5e47b130-f911-46dd-9804-7aad11e06814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:28:23.556569 dv-cinder-850618-3-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1481/2955] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 19 12:28:23 2022] DELETE /identity/v3/projects/c547d76e912044d0b6e1152fc0a85753 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:28:33.120993 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:28:33.550954 dv-cinder-850618-3-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=55 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:14.811725 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:31:14.813108 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:31:14.950151 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253a716-7232-4028-b3a2-1272b349b5e2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:31:15.008509 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d952d84-798d-4897-b6c1-05f992b81e52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aded088aa2a40e4b7fe024647ebfbed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '799dfd7d80ef4359964b56a02315bf35', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:31:15.009113 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952d84-798d-4897-b6c1-05f992b81e52 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:31:15.009393 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952d84-798d-4897-b6c1-05f992b81e52 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:31:15.009689 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952d84-798d-4897-b6c1-05f992b81e52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:31:15.011468 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4d952d84-798d-4897-b6c1-05f992b81e52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:31:15.023074 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d952d84-798d-4897-b6c1-05f992b81e52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:31:15.024629 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d952d84-798d-4897-b6c1-05f992b81e52 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:31:15.034241 dv-cinder-850618-3-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1475/2956] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 19 12:31:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:31:25.030121 dv-cinder-850618-3-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}